Jul 16 12:42:59 devstack cinder-volume[76352]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 12:42:59 devstack cinder-volume[76352]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 12:42:59 devstack cinder-volume[76352]: we strongly recommend against using it for new projects. Jul 16 12:42:59 devstack cinder-volume[76352]: If you are already using Eventlet, we recommend migrating to a different Jul 16 12:42:59 devstack cinder-volume[76352]: framework. For more detail see Jul 16 12:42:59 devstack cinder-volume[76352]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 12:42:59 devstack cinder-volume[76352]: import eventlet # noqa Jul 16 12:43:02 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:43:02 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:43:02 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:43:02 devstack cinder-volume[76352]: INFO dbcounter [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Registered counter for database cinder Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writer thread running {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.rpc [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.rpc [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Determined volume DB was empty at startup. Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG cinder.volume.manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76352) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 12:43:03 devstack cinder-volume[76352]: WARNING stevedore.named [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 12:43:03 devstack cinder-volume[76352]: WARNING castellan.key_manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:43:03 devstack cinder-volume[76352]: WARNING cinder.keymgr.conf_key_mgr [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG cinder.volume.drivers.lvm [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76352) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG oslo_concurrency.processutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] CMD "cinder-rtstool verify" returned: 0 in 0.388s {{(pid=76352) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:03 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.rpc [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.rpc [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 16 12:43:03 devstack cinder-volume[76352]: WARNING stevedore.named [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 12:43:03 devstack cinder-volume[76352]: WARNING castellan.key_manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:43:03 devstack cinder-volume[76352]: INFO cinder.volume.manager [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:43:04 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Starting 1 workers Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Started child 76487 {{(pid=76352) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Full set of CONF: {{(pid=76352) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] ******************************************************************************** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Configuration options gathered from: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] ================================================================================ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] allow_availability_zone_fallback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] allow_compression_on_image_upload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] allowed_direct_url_schemes = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] api_rate_limit = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] auth_strategy = keystone {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] az_cache_duration = 3600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_host = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_stats_polling_interval = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backup_api_class = cinder.backup.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backup_name_template = backup-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backup_use_same_host = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backup_use_temp_snapshot = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] chap_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_internal_tenant_project_id = b17675d50c6344d6a621267ab363a934 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_internal_tenant_user_id = 79307e9e24fc462f803141747756681d {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cloned_volume_same_az = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cluster = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] compression_format = gzip {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] compute_api_class = cinder.compute.nova.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] config_dir = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] config_source = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] control_exchange = openstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] debug = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] default_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] default_group_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] default_volume_type = lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76487]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_ssl_cert_verify = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] driver_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] enable_force_upload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] enable_new_services = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] enable_unsupported_driver = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] enabled_backends = ['lvmdriver-1'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] enforce_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_api_insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_api_ssl_compression = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_ca_certificates_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_catalog_info = image:glance:publicURL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_num_retries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance_request_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] graceful_shutdown_timeout = 5 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] group_api_class = cinder.group.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] host = devstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_compress_on_upload = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_conversion_address_space_limit = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_conversion_cpu_limit = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_conversion_disable = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_upload_use_cinder_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_upload_use_internal_tenant = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_volume_cache_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_volume_cache_max_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] image_volume_cache_max_size_gb = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] init_host_max_objects_retrieval = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] instance_format = [instance: %(uuid)s] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iscsi_target_flags = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iscsi_write_cache = on {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iser_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iser_ip_address = 192.168.122.82 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iser_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_color = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_config_append = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_options = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_rotate_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_rotate_interval_type = days {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] log_rotation_type = none {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] max_age = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] max_logfile_count = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] max_logfile_size_mb = 200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] max_over_subscription_ratio = 20.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] message_reap_interval = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] message_ttl = 2592000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] migration_create_volume_timeout_secs = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] monkey_patch = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] monkey_patch_modules = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] my_ip = 192.168.122.82 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] no_snapshot_gb_quota = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] num_iser_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] num_shell_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] num_volume_device_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] nvmeof_conn_info_version = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] nvmet_ns_id = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] nvmet_port_id = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_max_limit = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_ext_list = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_listen = 0.0.0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_listen_port = 8776 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] osapi_volume_workers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] per_volume_size_limit = -1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] periodic_fuzzy_delay = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] periodic_interval = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] project_id_regex = [0-9a-f\-]+ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] public_endpoint = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] publish_errors = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_backup_gigabytes = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_backups = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_gigabytes = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_groups = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_snapshots = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] quota_volumes = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] rate_limit_burst = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] rate_limit_except_level = CRITICAL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] rate_limit_interval = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] reinit_driver_count = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] report_discard_supported = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] report_interval = 120 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] reservation_clean_interval = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] reservation_expire = 86400 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] reserved_image_namespaces = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] reserved_percentage = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] rpc_response_timeout = 120 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] run_external_periodic_tasks = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] scst_target_driver = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_down_time = 720 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] shell_completion = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] snapshot_name_template = snapshot-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] snapshot_same_host = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] state_path = /opt/stack/data/cinder {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] storage_availability_zone = nova {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] storage_protocol = iSCSI {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] syslog_log_facility = LOG_USER {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_helper = lioadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_ip_address = 192.168.122.82 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] target_secondary_ip_addresses = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] transfer_api_class = cinder.transfer.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] transport_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] until_refresh = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_chap_auth = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_default_quota_class = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_journal = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_json = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_stderr = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] use_syslog = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] verify_glance_signatures = enabled {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_api_class = cinder.volume.api.API {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_clear_size = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_copy_bps_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_dd_blocksize = 1M {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_name_template = volume-%s {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_service_inithost_offload = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volume_usage_audit_period = month {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] zoning_mode = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_concurrency.disable_process_locking = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.auth_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.cache = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.delay_auth_decision = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.http_connect_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.include_service_catalog = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.interface = public {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_password = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcache_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.service_token_roles_required = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.service_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.token_cache_time = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.backend = dogpile.cache.null {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.backend_argument = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.backend_expiration_time = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.config_prefix = cache.oslo {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.debug_cache_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.enable_retry_client = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.enable_socket_keepalive = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.expiration_time = 600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.hashclient_retry_attempts = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_dead_retry = 300 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_pool_maxsize = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_sasl_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.proxies = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.redis_db = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.redis_sentinel_service_name = mymaster {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.redis_server = localhost:6379 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.retry_attempts = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.retry_delay = 0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.socket_keepalive_count = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.socket_keepalive_idle = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.socket_keepalive_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.socket_timeout = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.tls_allowed_ciphers = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.tls_cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.tls_certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.tls_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.tls_keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cache.username = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] coordination.backend_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.asyncio_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.asyncio_slave_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.backend = sqlalchemy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.connection_debug = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.connection_parameters = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.connection_recycle_time = 3600 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.connection_trace = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.db_inc_retry_interval = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.db_max_retries = 20 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.db_max_retry_interval = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.db_retry_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.max_overflow = 50 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.max_pool_size = 5 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.max_retries = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.mysql_wsrep_sync_wait = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.pool_timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.retry_interval = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.slave_connection = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.sqlite_synchronous = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.synchronous_reader = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] database.use_db_reconnect = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.connection_string = messaging:// {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.es_doc_type = notification {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.es_scroll_size = 10000 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.es_scroll_time = 2m {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.filter_error_trace = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.hmac_keys = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.sentinel_service_name = mymaster {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.socket_timeout = 0.1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.trace_requests = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler.trace_sqlalchemy = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler_jaeger.process_tags = {} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler_jaeger.service_name_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] profiler_otlp.service_name_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.enforce_new_defaults = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.enforce_scope = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.policy_default_rule = default {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.policy_file = policy.yaml {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_policy.remote_timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.group = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.helper_command = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] privsep_osbrick.user = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.group = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.helper_command = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] cinder_sys_admin.user = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.send_service_user_token = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] service_user.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.auth_type = password {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] glance.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack sudo[76491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack sudo[76491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.chap_username = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.driver_use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.enable_unsupported_driver = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.extra_capabilities = {} {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iscsi_target_flags = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iscsi_write_cache = on {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iser_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iser_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.lvm_mirrors = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.lvm_share_target = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.lvm_type = auto {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.num_shell_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.nvmet_port_id = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.report_discard_supported = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.reserved_percentage = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.scst_target_driver = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.storage_protocol = iSCSI {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_helper = tgtadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.unique_fqdn_network = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.use_chap_auth = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_backend_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_clear_size = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volume_group = cinder-volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_reports.file_event_handler = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_reports.log_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.backend_availability_zone = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.backend_host = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.chap_password = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.chap_username = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.chiscsi_conf = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.disk_geometry = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_client_cert = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_data_namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.driver_use_ssl = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.extra_capabilities = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.filter_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.goodness_function = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iser_helper = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iser_ip_address = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iser_port = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.iser_target_prefix = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.lvm_conf_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.lvm_mirrors = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.lvm_share_target = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.lvm_type = auto {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.num_shell_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.nvmet_port_id = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.replication_device = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.report_discard_supported = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.reserved_percentage = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.scst_target_driver = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.storage_protocol = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_helper = lioadm {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_ip_address = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_port = 3260 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_protocol = iscsi {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.trace_flags = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.use_chap_auth = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_clear = zero {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_clear_size = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] lvmdriver-1.volumes_dir = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.ssl_version = {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_notifications.driver = [] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_notifications.retry = -1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] oslo_messaging_notifications.transport_url = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] key_manager.fixed_key = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.barbican_api_version = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.barbican_endpoint = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.barbican_endpoint_type = public {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.barbican_region_name = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.number_of_retries = 60 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.retry_delay = 1 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.send_service_user_token = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.verify_ssl = True {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican.verify_ssl_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.auth_section = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.auth_type = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.cafile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.certfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.collect_timing = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.insecure = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.keyfile = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.split_loggers = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] barbican_service_user.timeout = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.approle_role_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.approle_secret_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.auth_method = approle {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.auth_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.kv_mountpoint = secret {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.kv_path = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.kv_version = 2 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.namespace = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.root_token_id = **** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.ssl_ca_crt_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.timeout = 60.0 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.token_file = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.token_role = None {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.use_ssl = False {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:43:04 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] ******************************************************************************** {{(pid=76352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 12:43:04 devstack sudo[76491]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack sudo[76494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:04 devstack sudo[76494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:04 devstack sudo[76494]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.270s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 12:43:04 devstack cinder-volume[76487]: INFO cinder.brick.local_dev.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:04 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:04 devstack sudo[76498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:04 devstack sudo[76498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:05 devstack sudo[76498]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG cinder.brick.local_dev.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76487) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:05 devstack sudo[76551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:05 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:05 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.529s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:05 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:05 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:05 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:05 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:05 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 16 12:43:05 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:06 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.262s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:06 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:06 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:06 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:06 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:06 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:06 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:06 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:06 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:06 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:07 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:07 devstack sudo[77164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:07 devstack sudo[77164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:07 devstack sudo[77164]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:07 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:07 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:07 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:07 devstack cinder-volume[76487]: INFO cinder.volume.drivers.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:07 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:07 devstack sudo[77231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:07 devstack sudo[77231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:08 devstack sudo[77231]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:08 devstack sudo[77286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:08 devstack sudo[77286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:08 devstack sudo[77286]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:08 devstack sudo[77289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:08 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:08 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:08 devstack sudo[77292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:08 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:08 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:08 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:08 devstack sudo[77295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:08 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:09 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:09 devstack cinder-volume[76487]: INFO cinder.volume.driver [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG cinder.volume.driver [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76487) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_db.sqlalchemy.engines [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76487) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writer thread running {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG cinder.db.api [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Building query based on filter {{(pid=76487) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG cinder.image.image_utils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76487) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 12:43:09 devstack cinder-volume[76487]: INFO cinder.keymgr.migration [None req-1ba20ac2-15d1-4559-b399-03ac7bb1a7b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:09 devstack sudo[77299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:09 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:09 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:09 devstack sudo[77302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:09 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:09 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:09 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:09 devstack sudo[77305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:09 devstack sudo[77305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:10 devstack sudo[77305]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:10 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:10 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:10 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:43:10 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Driver initialization completed successfully. Jul 16 12:43:10 devstack cinder-volume[76487]: INFO cinder.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Initiating service 2 cleanup Jul 16 12:43:10 devstack cinder-volume[76487]: INFO cinder.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Service 2 cleanup completed. Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG cinder.service [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Creating RPC server for service cinder-volume {{(pid=76487) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG cinder.service [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76487) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 12:43:10 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:10 devstack sudo[77320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:43:10 devstack sudo[77320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:10 devstack sudo[77320]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:10 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:10 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:10 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:11 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:11 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:11 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:11 devstack sudo[77328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:43:11 devstack sudo[77328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:11 devstack sudo[77328]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:11 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:11 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:43:11 devstack sudo[77331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:43:11 devstack sudo[77331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:43:11 devstack sudo[77331]: pam_unix(sudo:session): session closed for user root Jul 16 12:43:11 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:43:11 devstack cinder-volume[76487]: INFO cinder.volume.manager [None req-2f772c29-4b27-4e62-80a3-2d096cd31da3 None None] Driver post RPC initialization completed successfully. Jul 16 12:43:14 devstack cinder-volume[76352]: DEBUG dbcounter [-] [76352] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:43:21 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:43:21 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:43:53 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:43:53 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:43:53 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread info: [<_MainThread(MainThread, started 132325040201856)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:44:53 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:44:53 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:44:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:44:53 devstack sudo[81416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:44:53 devstack sudo[81416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:44:53 devstack sudo[81416]: pam_unix(sudo:session): session closed for user root Jul 16 12:44:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:44:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:44:53 devstack sudo[81555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:44:53 devstack sudo[81555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:44:54 devstack sudo[81555]: pam_unix(sudo:session): session closed for user root Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:44:54 devstack sudo[81704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:44:54 devstack sudo[81704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:44:54 devstack sudo[81704]: pam_unix(sudo:session): session closed for user root Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:44:54 devstack sudo[81849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:44:54 devstack sudo[81849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:44:54 devstack sudo[81849]: pam_unix(sudo:session): session closed for user root Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:44:54 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread info: [<_MainThread(MainThread, started 132325040201856)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:45:21 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:45:21 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:45:53 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:45:53 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:45:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:45:53 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:45:53 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:45:53 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Jul 16 12:45:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:45:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:45:53 devstack sudo[83910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:45:53 devstack sudo[83910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:45:54 devstack sudo[83910]: pam_unix(sudo:session): session closed for user root Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:45:54 devstack sudo[83922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:45:54 devstack sudo[83922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:45:54 devstack sudo[83922]: pam_unix(sudo:session): session closed for user root Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:45:54 devstack sudo[83927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:45:54 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:45:54 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:45:54 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:46:53 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:46:53 devstack cinder-volume[76487]: DEBUG cinder.volume.drivers.lvm [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Updating volume stats {{(pid=76487) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 16 12:46:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:46:53 devstack sudo[85227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 16 12:46:53 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:46:53 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root Jul 16 12:46:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:46:53 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:46:53 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:46:53 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:46:54 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:46:54 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 16 12:46:54 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:46:54 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:46:54 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 16 12:46:54 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:46:54 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_concurrency.processutils [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76487) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG cinder.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Notifying Schedulers of capabilities ... {{(pid=76487) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG oslo_service.periodic_task [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] Running periodic task VolumeManager._thread_info {{(pid=76487) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread count: 6 {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:46:54 devstack cinder-volume[76487]: DEBUG cinder.volume.manager [None req-92c207e2-f94f-461a-bdbe-dc485b67ca2e None None] thread info: [<_MainThread(MainThread, started 132325040201856)>, , , , , ] {{(pid=76487) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:47:21 devstack cinder-volume[76487]: DEBUG dbcounter [-] [76487] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76487) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:47:43 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Caught SIGTERM, stopping children Jul 16 12:47:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Acquiring lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:47:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Acquired lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:47:43 devstack cinder-volume[76352]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Releasing lock "singleton_lock" {{(pid=76352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:47:43 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Stop services. {{(pid=76352) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 12:47:43 devstack cinder-volume[76352]: DEBUG oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Killing children. {{(pid=76352) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 12:47:43 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Waiting on 1 children to exit Jul 16 12:47:45 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Acquiring lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:47:45 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Acquired lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:47:45 devstack cinder-volume[76487]: DEBUG oslo_concurrency.lockutils [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Releasing lock "singleton_lock" {{(pid=76487) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:47:45 devstack cinder-volume[76487]: WARNING amqp [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 12:47:45 devstack cinder-volume[76487]: WARNING amqp [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 12:47:45 devstack cinder-volume[76352]: INFO oslo_service.backend._eventlet.service [None req-cf5b0007-a7da-4be9-8c51-0ce11453bbad None None] Child 76487 exited with status 0 Jul 16 12:47:45 devstack cinder-volume[86591]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 12:47:45 devstack cinder-volume[86591]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 12:47:45 devstack cinder-volume[86591]: we strongly recommend against using it for new projects. Jul 16 12:47:45 devstack cinder-volume[86591]: If you are already using Eventlet, we recommend migrating to a different Jul 16 12:47:45 devstack cinder-volume[86591]: framework. For more detail see Jul 16 12:47:45 devstack cinder-volume[86591]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 12:47:45 devstack cinder-volume[86591]: import eventlet # noqa Jul 16 12:47:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:47:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:47:47 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:47:48 devstack cinder-volume[86591]: INFO dbcounter [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Registered counter for database cinder Jul 16 12:47:48 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG dbcounter [-] [86591] Writer thread running {{(pid=86591) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:47:49 devstack cinder-volume[86591]: INFO cinder.rpc [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 12:47:49 devstack cinder-volume[86591]: INFO cinder.rpc [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:47:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Determined volume DB was empty at startup. Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG cinder.volume.manager [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86591) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 12:47:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 16 12:47:49 devstack cinder-volume[86591]: WARNING stevedore.named [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 12:47:49 devstack cinder-volume[86591]: WARNING castellan.key_manager [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:47:49 devstack cinder-volume[86591]: WARNING cinder.keymgr.conf_key_mgr [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:47:49 devstack cinder-volume[86591]: INFO cinder.volume.manager [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_db.sqlalchemy.engines [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86591) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:47:49 devstack cinder-volume[86591]: INFO oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Starting 1 workers Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Started child 86825 {{(pid=86591) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Full set of CONF: {{(pid=86591) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] ******************************************************************************** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Configuration options gathered from: {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] ================================================================================ {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] allow_availability_zone_fallback = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] allow_compression_on_image_upload = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] allowed_direct_url_schemes = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] api_rate_limit = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] auth_strategy = keystone {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_availability_zone = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_host = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_stats_polling_interval = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backup_api_class = cinder.backup.api.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backup_name_template = backup-%s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backup_use_same_host = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backup_use_temp_snapshot = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] chap_password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] chap_username = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_internal_tenant_project_id = b17675d50c6344d6a621267ab363a934 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_internal_tenant_user_id = 79307e9e24fc462f803141747756681d {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86825]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cluster = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] compression_format = gzip {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] compute_api_class = cinder.compute.nova.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] config_dir = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] config_source = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] control_exchange = openstack {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] debug = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] default_availability_zone = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] default_group_type = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] default_volume_type = QuobyteHD {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] disk_geometry = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_client_cert = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_client_cert_key = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_data_namespace = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_ssl_cert_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_ssl_cert_verify = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] driver_use_ssl = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] enable_new_services = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] enable_unsupported_driver = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] enabled_backends = ['QuobyteHD'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] enforce_multipath_for_image_xfer = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] filter_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_api_insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_api_ssl_compression = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_ca_certificates_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_catalog_info = image:glance:publicURL {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_num_retries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance_request_timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] goodness_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] graceful_shutdown_timeout = 5 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] group_api_class = cinder.group.api.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] host = devstack {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_compress_on_upload = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_conversion_address_space_limit = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_conversion_cpu_limit = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_conversion_disable = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_upload_use_cinder_backend = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_upload_use_internal_tenant = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_volume_cache_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_volume_cache_max_count = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] image_volume_cache_max_size_gb = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] init_host_max_objects_retrieval = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] instance_format = [instance: %(uuid)s] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iscsi_target_flags = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iscsi_write_cache = on {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iser_helper = tgtadm {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iser_ip_address = 192.168.122.82 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iser_port = 3260 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_color = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_config_append = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_dir = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_options = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_rotate_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_rotate_interval_type = days {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] log_rotation_type = none {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] max_age = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] max_logfile_count = 30 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] max_logfile_size_mb = 200 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] max_over_subscription_ratio = 20.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] message_reap_interval = 86400 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] message_ttl = 2592000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] migration_create_volume_timeout_secs = 300 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] monkey_patch = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] monkey_patch_modules = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] my_ip = 192.168.122.82 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] no_snapshot_gb_quota = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] num_iser_scan_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] num_shell_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] num_volume_device_scan_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] nvmeof_conn_info_version = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] nvmet_ns_id = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] nvmet_port_id = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_max_limit = 1000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_ext_list = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_listen_port = 8776 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_use_ssl = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] osapi_volume_workers = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] per_volume_size_limit = -1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] periodic_fuzzy_delay = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] periodic_interval = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] public_endpoint = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] publish_errors = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_backup_gigabytes = 1000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_backups = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_gigabytes = 1000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_groups = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_snapshots = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] quota_volumes = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] rate_limit_burst = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] rate_limit_except_level = CRITICAL {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] rate_limit_interval = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] reinit_driver_count = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] replication_device = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] report_discard_supported = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] report_interval = 120 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] reservation_clean_interval = 86400 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] reservation_expire = 86400 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86825]: INFO cinder.volume.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Starting volume driver QuobyteDriver (1.2) Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.remotefs [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86825) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] reserved_image_namespaces = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] reserved_percentage = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] rpc_response_timeout = 120 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] run_external_periodic_tasks = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] scst_target_driver = iscsi {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] scst_target_iqn_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_down_time = 720 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] shell_completion = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] snapshot_name_template = snapshot-%s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] split_loggers = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] state_path = /opt/stack/data/cinder {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] storage_availability_zone = nova {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] storage_protocol = iSCSI {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] syslog_log_facility = LOG_USER {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_helper = lioadm {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_ip_address = 192.168.122.82 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_port = 3260 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_protocol = iscsi {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] target_secondary_ip_addresses = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] trace_flags = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] transport_url = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] until_refresh = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_chap_auth = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_default_quota_class = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_journal = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_json = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_multipath_for_image_xfer = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_stderr = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] use_syslog = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] verify_glance_signatures = enabled {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_api_class = cinder.volume.api.API {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_backend_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_clear = zero {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_clear_ionice = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_clear_size = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_copy_bps_limit = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_dd_blocksize = 1M {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_name_template = volume-%s {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_service_inithost_offload = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volume_usage_audit_period = month {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] zoning_mode = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_concurrency.disable_process_locking = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.auth_section = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.auth_type = password {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.auth_version = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.cache = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.include_service_catalog = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.interface = public {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_password = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcache_username = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.region_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.service_type = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.backend = dogpile.cache.null {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.backend_argument = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.backend_expiration_time = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.config_prefix = cache.oslo {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.debug_cache_backend = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.enable_retry_client = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.enable_socket_keepalive = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.expiration_time = 600 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.hashclient_retry_attempts = 2 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_dead_retry = 300 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_pool_maxsize = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_sasl_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.proxies = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.redis_db = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.redis_server = localhost:6379 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.retry_attempts = 2 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.retry_delay = 0.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.socket_keepalive_count = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.socket_keepalive_idle = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.socket_keepalive_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.socket_timeout = 1.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.tls_allowed_ciphers = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.tls_cafile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.tls_certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.tls_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.tls_keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cache.username = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] coordination.backend_url = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.asyncio_connection = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.asyncio_slave_connection = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.backend = sqlalchemy {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.connection = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.connection_debug = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.connection_parameters = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.connection_recycle_time = 3600 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.connection_trace = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.db_inc_retry_interval = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.db_max_retries = 20 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.db_max_retry_interval = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.db_retry_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.max_overflow = 50 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.max_pool_size = 5 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.max_retries = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.mysql_wsrep_sync_wait = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.pool_timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.retry_interval = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.slave_connection = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.sqlite_synchronous = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.synchronous_reader = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] database.use_db_reconnect = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.connection_string = messaging:// {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.es_doc_type = notification {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.es_scroll_size = 10000 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.es_scroll_time = 2m {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.filter_error_trace = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.hmac_keys = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.sentinel_service_name = mymaster {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.socket_timeout = 0.1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.trace_requests = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler.trace_sqlalchemy = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler_jaeger.process_tags = {} {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler_jaeger.service_name_prefix = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] profiler_otlp.service_name_prefix = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.enforce_new_defaults = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.enforce_scope = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.policy_default_rule = default {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.policy_file = policy.yaml {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.group = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.helper_command = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] privsep_osbrick.user = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.group = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.helper_command = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] cinder_sys_admin.user = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.auth_section = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.auth_type = password {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.cafile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.collect_timing = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.send_service_user_token = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.split_loggers = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] service_user.timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.auth_section = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.auth_type = password {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.collect_timing = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.region_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.split_loggers = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] glance.timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.backend_availability_zone = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.chap_password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.chap_username = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.disk_geometry = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_client_cert = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_client_cert_key = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_data_namespace = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.driver_use_ssl = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.extra_capabilities = {} {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.filter_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.goodness_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iscsi_target_flags = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iscsi_write_cache = on {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iser_helper = tgtadm {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iser_port = 3260 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_host = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_login = admin {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_mount_options = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_private_key = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_share_path = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.num_shell_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.quobyte_volume_url = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.replication_device = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.report_discard_supported = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.reserved_percentage = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_helper = tgtadm {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_port = 3260 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_protocol = iscsi {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.trace_flags = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.unique_fqdn_network = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.use_chap_auth = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_backend_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_clear = zero {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_clear_ionice = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_clear_size = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_reports.file_event_handler = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_reports.log_dir = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.backend_availability_zone = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.backend_host = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.chap_password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.chap_username = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.chiscsi_conf = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.disk_geometry = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_client_cert = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_data_namespace = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.driver_use_ssl = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.extra_capabilities = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.filter_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.goodness_function = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iser_helper = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iser_ip_address = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iser_port = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.iser_target_prefix = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_host = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_login = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_mount_options = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_password = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_private_key = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_share_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_ssh_port = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.num_shell_tries = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.nvmet_port_id = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86825) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 12:47:49 devstack cinder-volume[86825]: WARNING cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86825]: WARNING cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.replication_device = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.report_discard_supported = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.reserved_percentage = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.scst_target_driver = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Running cmd (subprocess): mount.quobyte {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.storage_protocol = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_helper = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_ip_address = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_port = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_prefix = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_protocol = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.trace_flags = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.use_chap_auth = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_clear = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_clear_size = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] QuobyteHD.volumes_dir = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_notifications.driver = [] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_notifications.retry = -1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] key_manager.fixed_key = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.barbican_api_version = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.barbican_endpoint = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.barbican_endpoint_type = public {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.barbican_region_name = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.cafile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.collect_timing = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.number_of_retries = 60 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.retry_delay = 1 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.send_service_user_token = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.split_loggers = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.verify_ssl = True {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican.verify_ssl_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.auth_section = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.auth_type = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.cafile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.certfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.collect_timing = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.insecure = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.keyfile = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.split_loggers = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] barbican_service_user.timeout = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.approle_role_id = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.approle_secret_id = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.auth_method = approle {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.auth_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.kv_mountpoint = secret {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.kv_path = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.kv_version = 2 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.namespace = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.root_token_id = **** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.ssl_ca_crt_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.timeout = 60.0 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.token_file = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.token_role = None {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.use_ssl = False {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:47:49 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] ******************************************************************************** {{(pid=86591) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 12:47:49 devstack quobyte-client[86830]: Reading configuration file: /etc/quobyte/client.cfg Jul 16 12:47:49 devstack quobyte-client[86830]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] CMD "mount.quobyte" returned: 1 in 0.100s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=86825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:47:49 devstack cinder-volume[86825]: INFO cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 ... Jul 16 12:47:49 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a -c /etc/quobyte/client-cinder.cfg {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:49 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a -c /etc/quobyte/client-cinder.cfg Jul 16 12:47:49 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:47:50 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.406s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 succeeded Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=86825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.420s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:50 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:47:50 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:47:50 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.265s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.volume.driver [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Driver hasn't implemented _init_vendor_properties() Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.volume.driver [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86825) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_db.sqlalchemy.engines [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86825) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG dbcounter [-] [86825] Writer thread running {{(pid=86825) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.db.api [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Building query based on filter {{(pid=86825) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.image.image_utils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86825) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.keymgr.migration [None req-1cceb6b2-73ba-4529-9e31-93e029d4a8ee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=86825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=86825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:50 devstack sudo[86920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:47:50 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:47:50 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.232s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Notifying Schedulers of capabilities ... {{(pid=86825) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.volume.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Driver initialization completed successfully. Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Initiating service 3 cleanup Jul 16 12:47:50 devstack cinder-volume[86825]: INFO cinder.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Service 3 cleanup completed. Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.service [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Creating RPC server for service cinder-volume {{(pid=86825) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 12:47:50 devstack cinder-volume[86825]: DEBUG cinder.service [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86825) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 12:47:51 devstack cinder-volume[86825]: INFO cinder.volume.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=86825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=86825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:51 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:47:51 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:47:51 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Jul 16 12:47:51 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.344s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:51 devstack cinder-volume[86825]: INFO cinder.volume.manager [None req-157cecbb-7a73-41bb-b90b-679305c8d69a None None] Driver post RPC initialization completed successfully. Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=86825) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG cinder.volume.drivers.quobyte [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=86825) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86825) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:47:56 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:47:56 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:47:56 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG oslo_concurrency.processutils [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.233s {{(pid=86825) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:47:56 devstack cinder-volume[86825]: DEBUG cinder.manager [None req-d43b48a1-c941-441e-a57e-6407430f2d46 None None] Notifying Schedulers of capabilities ... {{(pid=86825) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:47:59 devstack cinder-volume[86591]: INFO oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Caught SIGTERM, stopping children Jul 16 12:47:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Acquiring lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:47:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Acquired lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:47:59 devstack cinder-volume[86591]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Releasing lock "singleton_lock" {{(pid=86591) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:47:59 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Stop services. {{(pid=86591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 16 12:47:59 devstack cinder-volume[86591]: DEBUG oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Killing children. {{(pid=86591) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 16 12:47:59 devstack cinder-volume[86591]: INFO oslo_service.backend._eventlet.service [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Waiting on 1 children to exit Jul 16 12:48:00 devstack cinder-volume[86825]: DEBUG oslo_service.periodic_task [None req-f2dbff36-0432-427a-b9bd-a96e41665da3 None None] Running periodic task VolumeManager._thread_info {{(pid=86825) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:48:00 devstack cinder-volume[86825]: DEBUG cinder.volume.manager [None req-f2dbff36-0432-427a-b9bd-a96e41665da3 None None] thread count: 6 {{(pid=86825) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:48:00 devstack cinder-volume[86825]: DEBUG cinder.volume.manager [None req-f2dbff36-0432-427a-b9bd-a96e41665da3 None None] thread info: [<_MainThread(MainThread, started 139140021592192)>, , , , , ] {{(pid=86825) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:48:01 devstack cinder-volume[86825]: DEBUG dbcounter [-] [86825] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86825) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:48:01 devstack cinder-volume[86825]: DEBUG dbcounter [-] [86825] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86825) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:48:04 devstack cinder-volume[86825]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 16 12:48:04 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Acquiring lock "singleton_lock" {{(pid=86825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:48:04 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Acquired lock "singleton_lock" {{(pid=86825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:48:04 devstack cinder-volume[86825]: DEBUG oslo_concurrency.lockutils [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Releasing lock "singleton_lock" {{(pid=86825) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:48:04 devstack cinder-volume[86825]: WARNING amqp [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 12:48:04 devstack cinder-volume[86825]: WARNING amqp [None req-9428e992-ea13-4b45-a656-75b5c4f6f211 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 16 12:48:04 devstack cinder-volume[87318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 16 12:48:04 devstack cinder-volume[87318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 12:48:04 devstack cinder-volume[87318]: we strongly recommend against using it for new projects. Jul 16 12:48:04 devstack cinder-volume[87318]: If you are already using Eventlet, we recommend migrating to a different Jul 16 12:48:04 devstack cinder-volume[87318]: framework. For more detail see Jul 16 12:48:04 devstack cinder-volume[87318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 12:48:04 devstack cinder-volume[87318]: import eventlet # noqa Jul 16 12:48:07 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 16 12:48:07 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 16 12:48:07 devstack cinder-volume[87318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 16 12:48:07 devstack cinder-volume[87318]: INFO dbcounter [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Registered counter for database cinder Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG dbcounter [-] [87318] Writer thread running {{(pid=87318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:48:08 devstack cinder-volume[87318]: INFO cinder.rpc [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 16 12:48:08 devstack cinder-volume[87318]: INFO cinder.rpc [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:48:08 devstack cinder-volume[87318]: INFO cinder.volume.manager [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Determined volume DB was empty at startup. Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG cinder.volume.manager [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 16 12:48:08 devstack cinder-volume[87318]: WARNING stevedore.named [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 16 12:48:08 devstack cinder-volume[87318]: WARNING castellan.key_manager [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:48:08 devstack cinder-volume[87318]: WARNING cinder.keymgr.conf_key_mgr [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 16 12:48:08 devstack cinder-volume[87318]: INFO cinder.volume.manager [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_db.sqlalchemy.engines [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:48:08 devstack cinder-volume[87318]: INFO oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Starting 1 workers Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Started child 87560 {{(pid=87318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Full set of CONF: {{(pid=87318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] ******************************************************************************** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] Configuration options gathered from: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] ================================================================================ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 16 12:48:08 devstack cinder-volume[87560]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] allow_availability_zone_fallback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] allow_compression_on_image_upload = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] allowed_direct_url_schemes = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] api_rate_limit = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] auth_strategy = keystone {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_stats_polling_interval = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backup_api_class = cinder.backup.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backup_name_template = backup-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backup_use_same_host = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backup_use_temp_snapshot = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] chap_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_internal_tenant_project_id = b17675d50c6344d6a621267ab363a934 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_internal_tenant_user_id = 79307e9e24fc462f803141747756681d {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cluster = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] compression_format = gzip {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] compute_api_class = cinder.compute.nova.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] config_dir = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] config_source = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] control_exchange = openstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] debug = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] default_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] default_group_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] default_volume_type = QuobyteHD {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_ssl_cert_verify = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] driver_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] enable_new_services = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] enable_unsupported_driver = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] enabled_backends = ['QuobyteHD'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] enforce_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_api_insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_api_servers = ['http://192.168.122.82/image'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_api_ssl_compression = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_ca_certificates_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_catalog_info = image:glance:publicURL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_num_retries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance_request_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] graceful_shutdown_timeout = 5 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] group_api_class = cinder.group.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] host = devstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_compress_on_upload = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_conversion_address_space_limit = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_conversion_cpu_limit = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_conversion_disable = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_upload_use_cinder_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_upload_use_internal_tenant = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_volume_cache_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_volume_cache_max_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] image_volume_cache_max_size_gb = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] init_host_max_objects_retrieval = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] instance_format = [instance: %(uuid)s] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iscsi_target_flags = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iscsi_write_cache = on {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iser_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iser_ip_address = 192.168.122.82 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iser_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_color = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_config_append = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_options = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_rotate_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_rotate_interval_type = days {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] log_rotation_type = none {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] max_age = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] max_logfile_count = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] max_logfile_size_mb = 200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] max_over_subscription_ratio = 20.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] message_reap_interval = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] message_ttl = 2592000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] migration_create_volume_timeout_secs = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] monkey_patch = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] monkey_patch_modules = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] my_ip = 192.168.122.82 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] no_snapshot_gb_quota = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Starting volume driver QuobyteDriver (1.2) Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] num_iser_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87560) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] num_shell_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] num_volume_device_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] nvmeof_conn_info_version = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] nvmet_ns_id = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] nvmet_port_id = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_max_limit = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_ext_list = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_listen_port = 8776 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] osapi_volume_workers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] per_volume_size_limit = -1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] periodic_fuzzy_delay = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] periodic_interval = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] public_endpoint = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] publish_errors = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_backup_gigabytes = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_backups = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_gigabytes = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_groups = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_snapshots = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] quota_volumes = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] rate_limit_burst = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] rate_limit_except_level = CRITICAL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] rate_limit_interval = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] reinit_driver_count = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] report_discard_supported = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] report_interval = 120 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] reservation_clean_interval = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] reservation_expire = 86400 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] reserved_image_namespaces = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] reserved_percentage = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] rpc_response_timeout = 120 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] run_external_periodic_tasks = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] scst_target_driver = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_down_time = 720 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] shell_completion = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] snapshot_name_template = snapshot-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] state_path = /opt/stack/data/cinder {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] storage_availability_zone = nova {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] storage_protocol = iSCSI {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] syslog_log_facility = LOG_USER {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_helper = lioadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_ip_address = 192.168.122.82 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_protocol = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] target_secondary_ip_addresses = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] transport_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] until_refresh = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_chap_auth = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_default_quota_class = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_journal = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_json = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_stderr = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] use_syslog = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] verify_glance_signatures = enabled {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_api_class = cinder.volume.api.API {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_clear = zero {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_clear_size = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_copy_bps_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_dd_blocksize = 1M {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_name_template = volume-%s {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_service_inithost_offload = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volume_usage_audit_period = month {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] zoning_mode = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_concurrency.disable_process_locking = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.auth_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.include_service_catalog = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.interface = public {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_password = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcache_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.service_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.82/identity {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.backend = dogpile.cache.null {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.backend_argument = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.backend_expiration_time = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.config_prefix = cache.oslo {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.debug_cache_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.enable_retry_client = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.enable_socket_keepalive = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.expiration_time = 600 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.hashclient_retry_attempts = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_dead_retry = 300 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_pool_maxsize = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_sasl_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.proxies = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.redis_db = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.redis_server = localhost:6379 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.retry_attempts = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.retry_delay = 0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.socket_keepalive_count = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.socket_keepalive_idle = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.socket_keepalive_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.socket_timeout = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.tls_allowed_ciphers = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.tls_cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.tls_certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.tls_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.tls_keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cache.username = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] coordination.backend_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.asyncio_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.asyncio_slave_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.backend = sqlalchemy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.connection_debug = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.connection_parameters = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.connection_recycle_time = 3600 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.connection_trace = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.db_inc_retry_interval = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.db_max_retries = 20 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.db_max_retry_interval = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.db_retry_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.max_overflow = 50 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.max_pool_size = 5 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.max_retries = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.mysql_wsrep_sync_wait = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.pool_timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.retry_interval = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.slave_connection = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.sqlite_synchronous = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.synchronous_reader = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] database.use_db_reconnect = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87560) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.connection_string = messaging:// {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.es_doc_type = notification {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.es_scroll_size = 10000 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.es_scroll_time = 2m {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.filter_error_trace = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.hmac_keys = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.sentinel_service_name = mymaster {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Running cmd (subprocess): mount.quobyte {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.socket_timeout = 0.1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.trace_requests = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler.trace_sqlalchemy = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler_jaeger.process_tags = {} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler_jaeger.service_name_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] profiler_otlp.service_name_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.enforce_new_defaults = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.enforce_scope = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.policy_default_rule = default {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.policy_file = policy.yaml {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.group = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.helper_command = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] privsep_osbrick.user = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.group = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.helper_command = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] cinder_sys_admin.user = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.send_service_user_token = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] service_user.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.auth_type = password {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] glance.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.chap_username = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.driver_use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.extra_capabilities = {} {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iscsi_target_flags = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iscsi_write_cache = on {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iser_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iser_ip_address = 192.168.122.82 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iser_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_host = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_login = admin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_mount_options = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_private_key = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_share_path = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.num_shell_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.quobyte_volume_url = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.report_discard_supported = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.reserved_percentage = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_helper = tgtadm {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_ip_address = 192.168.122.82 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_port = 3260 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_protocol = iscsi {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.unique_fqdn_network = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.use_chap_auth = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_backend_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_clear = zero {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_clear_size = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_reports.file_event_handler = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_reports.log_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.backend_availability_zone = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.backend_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.chap_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.chap_username = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.chiscsi_conf = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.disk_geometry = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_client_cert = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_data_namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.driver_use_ssl = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.extra_capabilities = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.filter_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.goodness_function = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack quobyte-client[87561]: Reading configuration file: /etc/quobyte/client.cfg Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack quobyte-client[87561]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iser_helper = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iser_ip_address = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iser_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.iser_target_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_host = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_login = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_mount_options = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_password = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_private_key = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_share_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_ssh_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.num_shell_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.nvmet_port_id = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.replication_device = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.report_discard_supported = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.reserved_percentage = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.scst_target_driver = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.storage_protocol = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_helper = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_ip_address = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_port = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_prefix = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_protocol = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.trace_flags = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.use_chap_auth = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_clear = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_clear_size = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] QuobyteHD.volumes_dir = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_notifications.driver = [] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_notifications.retry = -1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] key_manager.fixed_key = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.barbican_api_version = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.barbican_endpoint = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.barbican_endpoint_type = public {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.barbican_region_name = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.number_of_retries = 60 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.retry_delay = 1 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.send_service_user_token = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.verify_ssl = True {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican.verify_ssl_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.auth_section = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.auth_type = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.cafile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.certfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.collect_timing = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.insecure = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.keyfile = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.split_loggers = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] barbican_service_user.timeout = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.approle_role_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.approle_secret_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.auth_method = approle {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.auth_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.kv_mountpoint = secret {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.kv_path = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.kv_version = 2 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.namespace = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.root_token_id = **** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.ssl_ca_crt_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.timeout = 60.0 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.token_file = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.token_role = None {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.use_ssl = False {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 16 12:48:08 devstack cinder-volume[87318]: DEBUG oslo_service.backend._eventlet.service [None req-68d7e165-6a93-4d03-94e3-b5090bf1f787 None None] ******************************************************************************** {{(pid=87318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 16 12:48:09 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.volume.driver [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Driver hasn't implemented _init_vendor_properties() Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.volume.driver [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_db.sqlalchemy.engines [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writer thread running {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.db.api [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Building query based on filter {{(pid=87560) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87560) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.keymgr.migration [None req-58cab8e3-6bd2-4b68-bdcb-76937ba73120 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 16 12:48:09 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:48:09 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:48:09 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.228s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Driver initialization completed successfully. Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Initiating service 3 cleanup Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Service 3 cleanup completed. Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.service [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Creating RPC server for service cinder-volume {{(pid=87560) start /opt/stack/cinder/cinder/service.py:231}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.service [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87560) start /opt/stack/cinder/cinder/service.py:237}} Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:48:09 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:48:09 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:48:09 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Jul 16 12:48:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:48:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-510ecd5b-4d01-43f7-9647-6e80a669e592 None None] Driver post RPC initialization completed successfully. Jul 16 12:48:18 devstack cinder-volume[87318]: DEBUG dbcounter [-] [87318] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:48:19 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:48:19 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:08 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:49:08 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:09 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.405s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:49:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:49:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 6 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:49:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Flow 'volume_create_manager' (5a5e99fa-aabb-4615-b8cb-dbbd53395610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177b3274-8841-4c4d-b618-eb781851ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (177b3274-8841-4c4d-b618-eb781851ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-503093351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509dc31-8d1b-4c4c-a66f-168737794923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf31198168245cd8ff6c8f12bf38dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:15Z,use_quota=True,user_id='8b71ad7c58c346af911ee41d376dde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ec3658-82d0-49fa-a7ff-f918fce46a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ec3658-82d0-49fa-a7ff-f918fce46a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4492d6ef-740a-4280-b915-3bf07029b580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4492d6ef-740a-4280-b915-3bf07029b580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8509dc31-8d1b-4c4c-a66f-168737794923', 'volume_name': 'volume-8509dc31-8d1b-4c4c-a66f-168737794923', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b251f717-301d-4dac-85fc-32dfeb230435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b251f717-301d-4dac-85fc-32dfeb230435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d16fccd-4aa2-42ba-b63c-9ecd93932955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Volume 8509dc31-8d1b-4c4c-a66f-168737794923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8509dc31-8d1b-4c4c-a66f-168737794923', 'volume_size': 1} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-503093351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509dc31-8d1b-4c4c-a66f-168737794923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf31198168245cd8ff6c8f12bf38dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:15Z,use_quota=True,user_id='8b71ad7c58c346af911ee41d376dde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Creating volume 8509dc31-8d1b-4c4c-a66f-168737794923 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:49:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:49:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:15 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 1073741824 Jul 16 12:49:15 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:16 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 1073741824" returned: 0 in 1.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:16 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 Jul 16 12:49:16 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:17 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923" returned: 0 in 0.450s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d16fccd-4aa2-42ba-b63c-9ecd93932955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8509dc31-8d1b-4c4c-a66f-168737794923', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaac4f9-cc85-4d7d-9411-149d863b1b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Volume volume-8509dc31-8d1b-4c4c-a66f-168737794923 (8509dc31-8d1b-4c4c-a66f-168737794923): created successfully Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaac4f9-cc85-4d7d-9411-149d863b1b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Flow 'volume_create_manager' (5a5e99fa-aabb-4615-b8cb-dbbd53395610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f4dca777-b079-4218-b730-63f4f8981360 tempest-DeleteServersTestJSON-185879880 None] Created volume successfully. Jul 16 12:49:23 devstack cinder-volume[87560]: WARNING py.warnings [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 16 12:49:23 devstack cinder-volume[87560]: .first() Jul 16 12:49:23 devstack cinder-volume[87560]: Jul 16 12:49:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-8509dc31-8d1b-4c4c-a66f-168737794923', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '437c9faf-75f5-48ce-a75a-78fb35a632c8', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:49:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-f9b583e3-a90d-406f-8fbe-7a9ee1663b2c req-63910dcc-e08d-4e15-9c8b-fa4c720583de tempest-DeleteServersTestJSON-185879880 None] attachment_update completed successfully. Jul 16 12:49:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8b41b813-8bc2-4d80-bfb3-3b2ad27f7972 req-86cca1f1-c606-4a31-a607-25e43ab129ec tempest-DeleteServersTestJSON-185879880 None] Terminate volume connection completed successfully. Jul 16 12:49:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-8b41b813-8bc2-4d80-bfb3-3b2ad27f7972 req-86cca1f1-c606-4a31-a607-25e43ab129ec tempest-DeleteServersTestJSON-185879880 None] Deleting attachment 437c9faf-75f5-48ce-a75a-78fb35a632c8. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Flow 'volume_create_manager' (c6728102-db8c-4e8b-a371-b3d198469443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea483e93-11a6-4a0c-9cd2-54c62f3495ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea483e93-11a6-4a0c-9cd2-54c62f3495ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-858871978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df7156c-1126-49a3-bd78-e5a86ec071cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7556f10b4de14323a9145da06a5223b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:31Z,use_quota=True,user_id='28a5233c1dbc427fafb768be212d6ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9501ed-d957-49aa-93c2-63c4127f7ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9501ed-d957-49aa-93c2-63c4127f7ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3f897b-a51a-48dd-b17c-2e507b1693f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3f897b-a51a-48dd-b17c-2e507b1693f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df7156c-1126-49a3-bd78-e5a86ec071cb', 'volume_name': 'volume-6df7156c-1126-49a3-bd78-e5a86ec071cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e3013-08ef-490c-ab04-41c91266b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880e3013-08ef-490c-ab04-41c91266b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b8ac32-af60-46e3-a91a-2b920a9babf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Volume 6df7156c-1126-49a3-bd78-e5a86ec071cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df7156c-1126-49a3-bd78-e5a86ec071cb', 'volume_size': 1} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-858871978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df7156c-1126-49a3-bd78-e5a86ec071cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7556f10b4de14323a9145da06a5223b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:31Z,use_quota=True,user_id='28a5233c1dbc427fafb768be212d6ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Creating volume 6df7156c-1126-49a3-bd78-e5a86ec071cb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:49:31 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:31 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb 1073741824 Jul 16 12:49:31 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:31 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb 1073741824" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:31 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb Jul 16 12:49:31 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:32 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b8ac32-af60-46e3-a91a-2b920a9babf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df7156c-1126-49a3-bd78-e5a86ec071cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bc88f6-69fa-4d6a-a2c3-3e26918744a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Volume volume-6df7156c-1126-49a3-bd78-e5a86ec071cb (6df7156c-1126-49a3-bd78-e5a86ec071cb): created successfully Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bc88f6-69fa-4d6a-a2c3-3e26918744a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Flow 'volume_create_manager' (c6728102-db8c-4e8b-a371-b3d198469443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fc3a5813-c170-4d7c-9dcf-033a1d498e3c tempest-VolumesAdminNegativeTest-360203540 None] Created volume successfully. Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "cinder-8509dc31-8d1b-4c4c-a66f-168737794923-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "cinder-8509dc31-8d1b-4c4c-a66f-168737794923-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "cinder-quobyte-8509dc31-8d1b-4c4c-a66f-168737794923" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "cinder-quobyte-8509dc31-8d1b-4c4c-a66f-168737794923" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:32 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4r2munet/privsep.sock'] Jul 16 12:49:32 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4r2munet/privsep.sock Jul 16 12:49:32 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Acquiring lock "cinder-6df7156c-1126-49a3-bd78-e5a86ec071cb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "cinder-6df7156c-1126-49a3-bd78-e5a86ec071cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Jul 16 12:49:33 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 16 12:49:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Acquiring lock "cinder-quobyte-6df7156c-1126-49a3-bd78-e5a86ec071cb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "cinder-quobyte-6df7156c-1126-49a3-bd78-e5a86ec071cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:34 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:34 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Spawned new privsep daemon via rootwrap Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Accepted privsep connection to /tmp/tmp4r2munet/privsep.sock {{(pid=87560) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 16 12:49:34 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 16 12:49:34 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 16 12:49:34 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 16 12:49:34 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89076 Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd67e3c-a34c-4df7-beaa-75ebc24961d9]: (2,) {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:34 devstack cinder-volume[87560]: WARNING oslo_privsep.priv_context [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] privsep daemon already running Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd5c5d-e9b0-4894-89bd-5e3576080381]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b44983-24cf-463c-bc84-2bf24012b230]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:34 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb Jul 16 12:49:34 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:34 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 Jul 16 12:49:34 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:34 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:34 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb Jul 16 12:49:34 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:34 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:34 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923 Jul 16 12:49:34 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:34 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6df7156c-1126-49a3-bd78-e5a86ec071cb" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "cinder-quobyte-6df7156c-1126-49a3-bd78-e5a86ec071cb" released by "delete_volume" :: held 1.197s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:35 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:49:35 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:49:35 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8509dc31-8d1b-4c4c-a66f-168737794923" returned: 0 in 0.520s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "cinder-quobyte-8509dc31-8d1b-4c4c-a66f-168737794923" released by "delete_volume" :: held 2.533s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Created reservations ['5bcd55e5-d8f1-46bc-b80c-86dd519be6ae', '3fa76034-dd06-4f00-b5ad-e67d7e55a199', '145f34ef-4257-4243-a729-8d9fef02bf67', '794f5f72-6202-4ed4-a371-46fe34d850c8'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:35 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:49:35 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Created reservations ['93f5f5a0-ad0a-44f4-ac02-21cc10bbab96', 'cb8bd037-ac03-4580-b3d5-77f2f4899950', '4fe5ca6c-f84a-4d50-a409-5aef64cd0396', '71456de0-89a7-4774-9cd3-ee9ec51cd281'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:35 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:49:35 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:35 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:49:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Deleted volume successfully. Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7090ee0-59f0-4a87-bc9c-af9822b3f0c6 tempest-VolumesAdminNegativeTest-360203540 None] Lock "cinder-6df7156c-1126-49a3-bd78-e5a86ec071cb-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:35 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:49:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Deleted volume successfully. Jul 16 12:49:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bfd5bf47-a731-452a-8a52-89046623b1cd tempest-DeleteServersTestJSON-185879880 None] Lock "cinder-8509dc31-8d1b-4c4c-a66f-168737794923-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (f81a8faa-1dcb-44c2-8532-f4ffbcd54c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab405a09-87e5-4adb-9104-0b5dce8213d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab405a09-87e5-4adb-9104-0b5dce8213d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1438931099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1bffac-7659-4656-98cf-8db53fe57f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:41Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116a1cba-4635-4ae5-8bf0-1f2c1b4f706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116a1cba-4635-4ae5-8bf0-1f2c1b4f706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f03a81-48d0-4c28-b76e-d8c99eedab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f03a81-48d0-4c28-b76e-d8c99eedab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1bffac-7659-4656-98cf-8db53fe57f79', 'volume_name': 'volume-bd1bffac-7659-4656-98cf-8db53fe57f79', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3986dba4-2c58-4945-9ffe-d62e0c099a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3986dba4-2c58-4945-9ffe-d62e0c099a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4737a05f-9db1-45d7-9f6d-6726375b4ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Volume bd1bffac-7659-4656-98cf-8db53fe57f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1bffac-7659-4656-98cf-8db53fe57f79', 'volume_size': 1} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1438931099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1bffac-7659-4656-98cf-8db53fe57f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:41Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Creating volume bd1bffac-7659-4656-98cf-8db53fe57f79 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:49:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:41 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 1073741824 Jul 16 12:49:41 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:41 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 1073741824" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:41 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 Jul 16 12:49:41 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:42 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4737a05f-9db1-45d7-9f6d-6726375b4ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1bffac-7659-4656-98cf-8db53fe57f79', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38452a1d-1401-453b-ad51-19a686612db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Volume volume-bd1bffac-7659-4656-98cf-8db53fe57f79 (bd1bffac-7659-4656-98cf-8db53fe57f79): created successfully Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38452a1d-1401-453b-ad51-19a686612db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (f81a8faa-1dcb-44c2-8532-f4ffbcd54c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4811c657-6b1a-4928-bc54-a07cb8d6a0df tempest-AttachVolumeTestJSON-292988874 None] Created volume successfully. Jul 16 12:49:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa3fdca8-e00d-4242-a0d8-26800ddbfdde req-17af78c9-895c-4cd9-b8b5-8bbcc66204f6 tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa3fdca8-e00d-4242-a0d8-26800ddbfdde req-17af78c9-895c-4cd9-b8b5-8bbcc66204f6 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa3fdca8-e00d-4242-a0d8-26800ddbfdde req-17af78c9-895c-4cd9-b8b5-8bbcc66204f6 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-fa3fdca8-e00d-4242-a0d8-26800ddbfdde req-17af78c9-895c-4cd9-b8b5-8bbcc66204f6 tempest-AttachVolumeTestJSON-292988874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-bd1bffac-7659-4656-98cf-8db53fe57f79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e4f4a18-037e-4024-a350-3d759225230a', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:49:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-fa3fdca8-e00d-4242-a0d8-26800ddbfdde req-17af78c9-895c-4cd9-b8b5-8bbcc66204f6 tempest-AttachVolumeTestJSON-292988874 None] attachment_update completed successfully. Jul 16 12:49:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Flow 'volume_create_manager' (b7c5c82f-7be9-4c63-9525-222bbf369c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3559dd87-5b16-4f7e-a3cd-bb6cde24a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3559dd87-5b16-4f7e-a3cd-bb6cde24a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-687606030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f185321c-44e9-43fa-b931-128522a84700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a704aa3eab43f48c0c32d11893ce64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:47Z,use_quota=True,user_id='3137a04ce40e44f58da10bb1472dcabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b44d4b-6efc-487f-90f8-026051da0b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b44d4b-6efc-487f-90f8-026051da0b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78c3ee-782b-41e4-a2cd-12b8579e388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78c3ee-782b-41e4-a2cd-12b8579e388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f185321c-44e9-43fa-b931-128522a84700', 'volume_name': 'volume-f185321c-44e9-43fa-b931-128522a84700', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb77ec7-37ce-4b18-83b0-5f2b1977656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb77ec7-37ce-4b18-83b0-5f2b1977656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df69b307-b626-4abd-a44e-385b6167e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Volume f185321c-44e9-43fa-b931-128522a84700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f185321c-44e9-43fa-b931-128522a84700', 'volume_size': 1} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-687606030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f185321c-44e9-43fa-b931-128522a84700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a704aa3eab43f48c0c32d11893ce64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:49:47Z,use_quota=True,user_id='3137a04ce40e44f58da10bb1472dcabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Creating volume f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:49:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:47 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 1073741824 Jul 16 12:49:47 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:47 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 1073741824" returned: 0 in 0.612s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:47 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 Jul 16 12:49:47 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:48 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df69b307-b626-4abd-a44e-385b6167e722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f185321c-44e9-43fa-b931-128522a84700', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c42e38a-7013-4f4a-8f28-f2a73dc3c191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:49:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Volume volume-f185321c-44e9-43fa-b931-128522a84700 (f185321c-44e9-43fa-b931-128522a84700): created successfully Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c42e38a-7013-4f4a-8f28-f2a73dc3c191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:49:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Flow 'volume_create_manager' (b7c5c82f-7be9-4c63-9525-222bbf369c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:49:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-416eb38f-3619-4132-b4b9-f391c9e78405 req-e85304e5-faf2-4d17-991c-03de2c4ccd71 tempest-VolumesSnapshotsTestJSON-899665275 None] Created volume successfully. Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Creating offline snapshot 7daa9297-59a2-4458-9a41-612e5299fb9e of volume f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd04e080-771a-466a-9b78-c18c880abbc9]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:49 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 Jul 16 12:49:49 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:49 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:50 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e 1G Jul 16 12:49:50 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:50 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e 1G" returned: 0 in 0.469s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f185321c-44e9-43fa-b931-128522a84700 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:50 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f185321c-44e9-43fa-b931-128522a84700 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e Jul 16 12:49:50 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:50 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f185321c-44e9-43fa-b931-128522a84700 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:50 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e is being set with open permissions: ugo+rw Jul 16 12:49:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:50 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e Jul 16 12:49:50 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:51 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:51 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info Jul 16 12:49:51 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:51 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:51 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info is being set with open permissions: ugo+rw Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:51 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info Jul 16 12:49:51 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:51 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.info" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-1c0801ae-24f1-435d-929f-9441ab59e15b req-a5acd8a2-2496-41fe-823c-ac8f59a73ae9 tempest-VolumesSnapshotsTestJSON-899665275 None] Create snapshot completed successfully Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "cinder-7daa9297-59a2-4458-9a41-612e5299fb9e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-7daa9297-59a2-4458-9a41-612e5299fb9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "cinder-quobyte-7daa9297-59a2-4458-9a41-612e5299fb9e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-7daa9297-59a2-4458-9a41-612e5299fb9e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Deleting offline snapshot 7daa9297-59a2-4458-9a41-612e5299fb9e of volume f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] snapshot_file for this snap is: volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[09271537-33d0-480d-9756-3e56d752f152]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:52 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e Jul 16 12:49:52 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:52 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e" returned: 0 in 0.441s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f185321c-44e9-43fa-b931-128522a84700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af58e1b6-008f-4579-9199-5bda51a8a6e9]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:52 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 Jul 16 12:49:52 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:53 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:53 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e Jul 16 12:49:53 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:53 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:53 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e Jul 16 12:49:53 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:53 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700.7daa9297-59a2-4458-9a41-612e5299fb9e" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-7daa9297-59a2-4458-9a41-612e5299fb9e" released by "_delete_snapshot" :: held 1.794s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" released by "delete_snapshot" :: held 1.830s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:54 devstack cinder-volume[87560]: WARNING cinder.quota [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.quota [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Created reservations ['e6f6c3c9-bf45-4c7f-8ae4-2b9469da59e0', 'ae315fcb-bf68-4e9a-b1f5-58eefe1afa3d', '3fa0c33f-5d9d-4ff0-932e-ed90dacf8070', '0666d91f-33e3-4e5c-bf85-a9f29c6f5a44'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:49:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Delete snapshot completed successfully. Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-599698d7-e3e2-4a0c-8afc-52c7d0e6c75e req-e849f409-5920-4c85-bbb4-8e3ee91f5943 tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-7daa9297-59a2-4458-9a41-612e5299fb9e-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "cinder-f185321c-44e9-43fa-b931-128522a84700-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-f185321c-44e9-43fa-b931-128522a84700-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:49:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9a4cfe-5b5d-46fb-81df-61acc56717fd]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:55 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 Jul 16 12:49:55 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:55 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:55 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700 Jul 16 12:49:55 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:55 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f185321c-44e9-43fa-b931-128522a84700" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-quobyte-f185321c-44e9-43fa-b931-128522a84700" released by "delete_volume" :: held 0.976s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG cinder.quota [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Created reservations ['e8efde62-9646-4d97-83ab-2d0505a56c5b', '178c481b-57a8-411b-ba25-c7d0cdc40f07', '97582eed-d321-4ee7-8f52-ee2995c10341', '2f26b3e0-68b4-4479-b346-b9134ba5b0b2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:49:56 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:49:56 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:49:56 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG cinder.manager [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:49:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Deleted volume successfully. Jul 16 12:49:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-5ce7349f-eda6-4b77-ba6e-65ec978eb72b req-92d39cb6-0723-413f-8187-0b5fdbc2035e tempest-VolumesSnapshotsTestJSON-899665275 None] Lock "cinder-f185321c-44e9-43fa-b931-128522a84700-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:06 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=44,cinder:INSERT=10,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:50:06 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=45,cinder:SELECT=48,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:08 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:50:08 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:09 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Flow 'volume_create_manager' (bafc48d2-0bf8-4099-a27d-92d52b4e9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e54dc47-5659-4ee1-ac09-0e2eb1efa3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e54dc47-5659-4ee1-ac09-0e2eb1efa3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-162961679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d4abdd-0628-4f2d-9def-be41d65f9766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29da3d15587e4e918351e5dc514ee080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:17Z,use_quota=True,user_id='e3f10f0c6ec042ca9f0f9ceefe7dec52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f8d0d6-81f0-4345-84d3-1e1789e7f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f8d0d6-81f0-4345-84d3-1e1789e7f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6407d1b7-60cb-47cc-8665-94c58b1ffc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6407d1b7-60cb-47cc-8665-94c58b1ffc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d4abdd-0628-4f2d-9def-be41d65f9766', 'volume_name': 'volume-b4d4abdd-0628-4f2d-9def-be41d65f9766', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767a12f0-c1b8-40d8-93b7-39041a3fd5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767a12f0-c1b8-40d8-93b7-39041a3fd5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72aef48-db26-4f6f-89c5-a2ee6ee039ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Volume b4d4abdd-0628-4f2d-9def-be41d65f9766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d4abdd-0628-4f2d-9def-be41d65f9766', 'volume_size': 1} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-162961679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d4abdd-0628-4f2d-9def-be41d65f9766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29da3d15587e4e918351e5dc514ee080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:17Z,use_quota=True,user_id='e3f10f0c6ec042ca9f0f9ceefe7dec52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Creating volume b4d4abdd-0628-4f2d-9def-be41d65f9766 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:50:17 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:17 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 1073741824 Jul 16 12:50:17 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:17 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 1073741824" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:17 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 Jul 16 12:50:17 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:18 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72aef48-db26-4f6f-89c5-a2ee6ee039ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d4abdd-0628-4f2d-9def-be41d65f9766', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a6a8be-4427-4f41-8685-a76901dc46c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Volume volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 (b4d4abdd-0628-4f2d-9def-be41d65f9766): created successfully Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a6a8be-4427-4f41-8685-a76901dc46c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Flow 'volume_create_manager' (bafc48d2-0bf8-4099-a27d-92d52b4e9488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9db7d1f3-6bae-43b7-a4b5-c6b41d1af31e tempest-TaggedAttachmentsTest-807934023 None] Created volume successfully. Jul 16 12:50:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-619403b7-636e-4d44-812f-0cb88340cb17 req-9f316efa-d83d-4a0d-a461-6af325f48072 tempest-AttachVolumeTestJSON-292988874 None] Terminate volume connection completed successfully. Jul 16 12:50:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-619403b7-636e-4d44-812f-0cb88340cb17 req-9f316efa-d83d-4a0d-a461-6af325f48072 tempest-AttachVolumeTestJSON-292988874 None] Deleting attachment 3e4f4a18-037e-4024-a350-3d759225230a. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:50:28 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:50:32 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Flow 'volume_create_manager' (9bff7152-1600-45d5-97b8-90b9c1fe111d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82390111-92f3-4f3e-a794-355f13020b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82390111-92f3-4f3e-a794-355f13020b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1213925965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9900856c-67f0-49a9-8fa5-9c851c0cdbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28aac80b7c4a5db914c905f4ef5dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:33Z,use_quota=True,user_id='09167d6b67ee443eb969c47ef24e64b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42028e8f-423a-4812-ba3b-95f36097906e),volume_type_id=42028e8f-423a-4812-ba3b-95f36097906e)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2ebb52-f899-4019-9bb9-29eff3b4341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd2ebb52-f899-4019-9bb9-29eff3b4341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803e9a30-f12c-4404-a5a0-98a2720c4c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803e9a30-f12c-4404-a5a0-98a2720c4c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9900856c-67f0-49a9-8fa5-9c851c0cdbdf', 'volume_name': 'volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44041857-aff4-4659-a4ab-e6cbe69ca4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44041857-aff4-4659-a4ab-e6cbe69ca4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bd046c-3ee4-4d9b-91ef-094a98da2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Volume 9900856c-67f0-49a9-8fa5-9c851c0cdbdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf', 'volume_size': 1} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1213925965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9900856c-67f0-49a9-8fa5-9c851c0cdbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb28aac80b7c4a5db914c905f4ef5dfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:33Z,use_quota=True,user_id='09167d6b67ee443eb969c47ef24e64b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42028e8f-423a-4812-ba3b-95f36097906e),volume_type_id=42028e8f-423a-4812-ba3b-95f36097906e)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Creating volume 9900856c-67f0-49a9-8fa5-9c851c0cdbdf {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:50:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:50:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:33 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf 1073741824 Jul 16 12:50:33 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:34 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf 1073741824" returned: 0 in 0.779s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:34 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf Jul 16 12:50:34 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:34 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8bd046c-3ee4-4d9b-91ef-094a98da2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e66875-365f-4510-a1e0-c6d051e2628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Volume volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf (9900856c-67f0-49a9-8fa5-9c851c0cdbdf): created successfully Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e66875-365f-4510-a1e0-c6d051e2628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Flow 'volume_create_manager' (9bff7152-1600-45d5-97b8-90b9c1fe111d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-63e8fe3d-0afc-4401-bb71-f97e3e1cda16 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Created volume successfully. Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:36 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:50:36 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:37 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.485s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:37 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:50:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fcdcf004-90fd-4e7d-bb13-7ba3b170f11d tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Retype volume completed successfully. Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "cinder-9900856c-67f0-49a9-8fa5-9c851c0cdbdf-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "cinder-9900856c-67f0-49a9-8fa5-9c851c0cdbdf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "cinder-quobyte-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "cinder-quobyte-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d62452-a2da-4261-bf57-ebd8f71ae4a2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:50:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:38 devstack sudo[90567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf Jul 16 12:50:38 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:39 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" returned: 0 in 0.523s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:39 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf Jul 16 12:50:39 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:39 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "cinder-quobyte-9900856c-67f0-49a9-8fa5-9c851c0cdbdf" released by "delete_volume" :: held 1.009s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:39 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:50:39 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Created reservations ['e24bf5f5-3082-48e4-8d9b-11fa7eb5bb0a', 'a3725b3f-83a2-4465-b392-9e7cdf0a5466', 'c7ae691f-3e42-4481-a093-27b9ff7b9f98', '2ee769bb-c52f-4f03-a59c-6bc0d0cf6bb6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:39 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:50:39 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:40 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:40 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:50:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Deleted volume successfully. Jul 16 12:50:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d3bfa9d5-23f7-42fe-a8d0-58e651fffdf6 tempest-VolumeRetypeWithoutMigrationTest-1348293184 None] Lock "cinder-9900856c-67f0-49a9-8fa5-9c851c0cdbdf-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Flow 'volume_create_manager' (954e2a5e-927b-4843-9cbf-3ece34ce4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0130c9-1711-4df3-bb68-92fc427a4e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0130c9-1711-4df3-bb68-92fc427a4e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1361599340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39465326-2040-4d30-81ec-625c58ec8267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36541f70e6614d93b07eead5eb0ca054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:48Z,use_quota=True,user_id='67f147d3760c447287480a4f43dbbf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5f5d18-837b-4d0b-a691-d491e3acd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5f5d18-837b-4d0b-a691-d491e3acd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51e46e6-ac91-40e7-be70-ae7c05b0469c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51e46e6-ac91-40e7-be70-ae7c05b0469c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39465326-2040-4d30-81ec-625c58ec8267', 'volume_name': 'volume-39465326-2040-4d30-81ec-625c58ec8267', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6de3b5-a958-4dda-80d7-39c25c729079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6de3b5-a958-4dda-80d7-39c25c729079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6299bb2-fd9a-4d86-b1d8-cc2e033156ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Volume 39465326-2040-4d30-81ec-625c58ec8267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39465326-2040-4d30-81ec-625c58ec8267', 'volume_size': 1} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1361599340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39465326-2040-4d30-81ec-625c58ec8267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36541f70e6614d93b07eead5eb0ca054',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:50:48Z,use_quota=True,user_id='67f147d3760c447287480a4f43dbbf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Creating volume 39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:50:48 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:48 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 1073741824 Jul 16 12:50:48 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:48 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 1073741824" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:49 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 Jul 16 12:50:49 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:49 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6299bb2-fd9a-4d86-b1d8-cc2e033156ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39465326-2040-4d30-81ec-625c58ec8267', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c559741-2179-40cf-aaa3-509928cf7f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:50:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Volume volume-39465326-2040-4d30-81ec-625c58ec8267 (39465326-2040-4d30-81ec-625c58ec8267): created successfully Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c559741-2179-40cf-aaa3-509928cf7f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Flow 'volume_create_manager' (954e2a5e-927b-4843-9cbf-3ece34ce4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:50:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b9b4cdd4-8d00-48f6-ab1d-a6e9f684a973 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Created volume successfully. Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Creating offline snapshot 572e9dcf-a885-465a-b5d9-172310a25b8e of volume 39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33cb49f-e676-476c-be3b-16932a5b4469]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:50:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:49 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 Jul 16 12:50:49 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:50 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:50 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e 1G Jul 16 12:50:50 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:50 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e 1G" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39465326-2040-4d30-81ec-625c58ec8267 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:50 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39465326-2040-4d30-81ec-625c58ec8267 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e Jul 16 12:50:50 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:50 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39465326-2040-4d30-81ec-625c58ec8267 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:50 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e is being set with open permissions: ugo+rw Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:50 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e Jul 16 12:50:50 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:50 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:51 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info Jul 16 12:50:51 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:51 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:51 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info is being set with open permissions: ugo+rw Jul 16 12:50:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:51 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info Jul 16 12:50:51 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:51 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.info" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-83d19add-3138-48ce-89f4-9954f3cbf79b tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Create snapshot completed successfully Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "cinder-572e9dcf-a885-465a-b5d9-172310a25b8e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-572e9dcf-a885-465a-b5d9-172310a25b8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "cinder-quobyte-572e9dcf-a885-465a-b5d9-172310a25b8e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-572e9dcf-a885-465a-b5d9-172310a25b8e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Deleting offline snapshot 572e9dcf-a885-465a-b5d9-172310a25b8e of volume 39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] snapshot_file for this snap is: volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc58bf18-c241-47a7-a476-fb76f73401a7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:52 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e Jul 16 12:50:52 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:52 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39465326-2040-4d30-81ec-625c58ec8267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5408c4cb-819e-454b-bdef-29cccfeecbb2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:52 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 Jul 16 12:50:52 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:52 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:53 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e Jul 16 12:50:53 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:53 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:53 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e Jul 16 12:50:53 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:53 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267.572e9dcf-a885-465a-b5d9-172310a25b8e" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-572e9dcf-a885-465a-b5d9-172310a25b8e" released by "_delete_snapshot" :: held 1.415s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" released by "delete_snapshot" :: held 1.439s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Created reservations ['52814015-dae5-4df3-9299-c6035cedf4ab', '411a4998-d777-45f5-9548-cdf9eeaebc5a', 'fdd9c3f3-e54e-4a99-9bb9-2fd313ec5da2', '2f240943-2e78-4a83-b2db-30faa02121df'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:50:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Delete snapshot completed successfully. Jul 16 12:50:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd0c0545-b89f-4646-b5e1-fb84df5330ca tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-572e9dcf-a885-465a-b5d9-172310a25b8e-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "cinder-39465326-2040-4d30-81ec-625c58ec8267-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-39465326-2040-4d30-81ec-625c58ec8267-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e174639-9939-466d-a3a6-462facfc6963]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:54 devstack sudo[90708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 Jul 16 12:50:54 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:54 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:54 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267 Jul 16 12:50:54 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:55 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-39465326-2040-4d30-81ec-625c58ec8267" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-quobyte-39465326-2040-4d30-81ec-625c58ec8267" released by "delete_volume" :: held 0.664s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Created reservations ['c26d8779-6be9-46bd-8208-d34f1e3e68db', 'c23de32a-03a8-4133-9b03-c909f53850ce', 'a52f1fcb-71d5-4766-aac6-dcdf4a4f034b', '9b5f27ee-621c-4b70-8185-90dab7f14f7b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:50:55 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:50:55 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:50:55 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:50:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Deleted volume successfully. Jul 16 12:50:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-88244f9c-59a3-4f4e-8a0d-7d123e4e5562 tempest-VolumeSnapshotQuotasNegativeTestJSON-1936809678 None] Lock "cinder-39465326-2040-4d30-81ec-625c58ec8267-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-06b25cf9-33b2-4f8e-954a-4cb9d40caee5 req-fffc2ba8-72a4-4770-99e2-91132385e955 tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-06b25cf9-33b2-4f8e-954a-4cb9d40caee5 req-fffc2ba8-72a4-4770-99e2-91132385e955 tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-06b25cf9-33b2-4f8e-954a-4cb9d40caee5 req-fffc2ba8-72a4-4770-99e2-91132385e955 tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-06b25cf9-33b2-4f8e-954a-4cb9d40caee5 req-fffc2ba8-72a4-4770-99e2-91132385e955 tempest-TaggedAttachmentsTest-807934023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-b4d4abdd-0628-4f2d-9def-be41d65f9766', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c95a5895-14d3-4d44-885c-983a9575cdbb', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:51:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-06b25cf9-33b2-4f8e-954a-4cb9d40caee5 req-fffc2ba8-72a4-4770-99e2-91132385e955 tempest-TaggedAttachmentsTest-807934023 None] attachment_update completed successfully. Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Flow 'volume_create_manager' (3a8b1c06-5a20-4d2c-ac79-8867d8b194b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59213b3c-1f5c-4244-a4da-a92937d57aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59213b3c-1f5c-4244-a4da-a92937d57aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-151074544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ea4c43-6165-4278-9b39-4d0cfa4ef057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988ec63c2fc146b0b6ca766ae46cf20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:05Z,use_quota=True,user_id='1af533179d134fde960e0d9af459fd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f24bc43-0e11-4752-8a0d-1fcb527bfe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f24bc43-0e11-4752-8a0d-1fcb527bfe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6c3e0-e914-4ca1-99ac-49d4d45d150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd6c3e0-e914-4ca1-99ac-49d4d45d150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'volume_name': 'volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8284d559-29d0-455b-af8c-0da37ca5c854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8284d559-29d0-455b-af8c-0da37ca5c854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ff68b-5712-4938-b66d-00e31fb19253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Volume 32ea4c43-6165-4278-9b39-4d0cfa4ef057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'volume_size': 1} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-151074544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ea4c43-6165-4278-9b39-4d0cfa4ef057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988ec63c2fc146b0b6ca766ae46cf20d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:05Z,use_quota=True,user_id='1af533179d134fde960e0d9af459fd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Creating volume 32ea4c43-6165-4278-9b39-4d0cfa4ef057 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:05 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 1073741824 Jul 16 12:51:05 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:05 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 1073741824" returned: 0 in 0.582s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:05 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 Jul 16 12:51:05 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:06 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ff68b-5712-4938-b66d-00e31fb19253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f00ca55-df87-4a7f-b8a4-1e013b982c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Volume volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 (32ea4c43-6165-4278-9b39-4d0cfa4ef057): created successfully Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f00ca55-df87-4a7f-b8a4-1e013b982c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Flow 'volume_create_manager' (3a8b1c06-5a20-4d2c-ac79-8867d8b194b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1d72b8a5-8dff-4947-b002-164ccd29ef7c tempest-ServerActionsTestOtherA-999385629 None] Created volume successfully. Jul 16 12:51:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-0dcc422d-2857-4e8d-b02c-472cfa7eadaf req-f8c919fd-4734-4d60-baf6-df1f70d10b13 tempest-TaggedAttachmentsTest-807934023 None] Terminate volume connection completed successfully. Jul 16 12:51:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-0dcc422d-2857-4e8d-b02c-472cfa7eadaf req-f8c919fd-4734-4d60-baf6-df1f70d10b13 tempest-TaggedAttachmentsTest-807934023 None] Deleting attachment c95a5895-14d3-4d44-885c-983a9575cdbb. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:51:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:51:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:51:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:51:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=37,cinder:SELECT=42,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:51:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=37,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Flow 'volume_create_manager' (5a0852ef-a9d3-4803-9cf9-b013487452d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a94ec-a0fb-45e8-99ba-427639bffc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (742a94ec-a0fb-45e8-99ba-427639bffc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-26061036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a90770-ab84-45c9-a1fe-da958959b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74c3dda19f742e9a2e172bcac4465df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:18Z,use_quota=True,user_id='37c9f1f88d3a4149837cffc94e88d4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ee859-1890-4cb5-b2cc-10d3a564d45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ee859-1890-4cb5-b2cc-10d3a564d45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f12bb-4da8-4d6c-97a0-73b790f49eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (746f12bb-4da8-4d6c-97a0-73b790f49eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a90770-ab84-45c9-a1fe-da958959b556', 'volume_name': 'volume-31a90770-ab84-45c9-a1fe-da958959b556', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb114e0-dc88-4898-b743-4ecc5144bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb114e0-dc88-4898-b743-4ecc5144bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c9cfeb-7fb4-4da6-9b74-4a10972d109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Volume 31a90770-ab84-45c9-a1fe-da958959b556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a90770-ab84-45c9-a1fe-da958959b556', 'volume_size': 1} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-26061036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a90770-ab84-45c9-a1fe-da958959b556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b74c3dda19f742e9a2e172bcac4465df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:18Z,use_quota=True,user_id='37c9f1f88d3a4149837cffc94e88d4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Creating volume 31a90770-ab84-45c9-a1fe-da958959b556 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:18 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 1073741824 Jul 16 12:51:18 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:18 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 1073741824" returned: 0 in 0.595s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:18 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 Jul 16 12:51:18 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:19 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c9cfeb-7fb4-4da6-9b74-4a10972d109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a90770-ab84-45c9-a1fe-da958959b556', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ab27c-20b6-45c9-b9fa-77eb21b7b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Volume volume-31a90770-ab84-45c9-a1fe-da958959b556 (31a90770-ab84-45c9-a1fe-da958959b556): created successfully Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ab27c-20b6-45c9-b9fa-77eb21b7b785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Flow 'volume_create_manager' (5a0852ef-a9d3-4803-9cf9-b013487452d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-018ec5d6-6ad8-462e-9476-807d9c32a867 tempest-AbsoluteLimitsTests-398715678 None] Created volume successfully. Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Acquiring lock "cinder-31a90770-ab84-45c9-a1fe-da958959b556-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "cinder-31a90770-ab84-45c9-a1fe-da958959b556-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Acquiring lock "cinder-quobyte-31a90770-ab84-45c9-a1fe-da958959b556" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "cinder-quobyte-31a90770-ab84-45c9-a1fe-da958959b556" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[710bc235-d331-4257-b1be-f34977bfbf71]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:51:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:20 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 Jul 16 12:51:20 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "cinder-b4d4abdd-0628-4f2d-9def-be41d65f9766-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "cinder-b4d4abdd-0628-4f2d-9def-be41d65f9766-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:21 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "cinder-quobyte-b4d4abdd-0628-4f2d-9def-be41d65f9766" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556" returned: 0 in 0.746s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "cinder-quobyte-b4d4abdd-0628-4f2d-9def-be41d65f9766" acquired by "delete_volume" :: waited 0.059s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:21 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556 Jul 16 12:51:21 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3016e1-4c84-418c-8366-3276109a919a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:51:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:21 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 Jul 16 12:51:21 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:22 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31a90770-ab84-45c9-a1fe-da958959b556" returned: 0 in 0.668s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "cinder-quobyte-31a90770-ab84-45c9-a1fe-da958959b556" released by "delete_volume" :: held 1.529s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Created reservations ['b7d15400-7cd5-44cb-a51e-319076aa44c3', '79cbdf3e-2c03-4496-be6d-c73564240a32', '008b1893-578e-4e89-baec-5e90779a2594', 'c436f043-ed12-46b8-a45a-33c4343b95ea'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:22 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766" returned: 0 in 0.888s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:22 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:51:22 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:22 devstack sudo[91415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766 Jul 16 12:51:22 devstack sudo[91415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:22 devstack sudo[91415]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b4d4abdd-0628-4f2d-9def-be41d65f9766" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "cinder-quobyte-b4d4abdd-0628-4f2d-9def-be41d65f9766" released by "delete_volume" :: held 1.450s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:23 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.610s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:51:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Deleted volume successfully. Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-080096d8-e55a-4bd7-bf34-bc4ad8a9e82e tempest-AbsoluteLimitsTests-398715678 None] Lock "cinder-31a90770-ab84-45c9-a1fe-da958959b556-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Created reservations ['b1146827-33a1-42e5-a970-729558a84be0', '009bc1e7-c9c8-4dc5-8d28-882415f1f8f7', '797dd7a3-33b6-4ef7-8b09-9e86c7fab0ad', '9dc66bc7-022f-4867-a176-f540ad2b6f8a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:23 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:51:23 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:24 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.639s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:51:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Deleted volume successfully. Jul 16 12:51:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab93303c-69f2-4f6f-89f9-a6808321f5c9 tempest-TaggedAttachmentsTest-807934023 None] Lock "cinder-b4d4abdd-0628-4f2d-9def-be41d65f9766-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Flow 'volume_create_manager' (a0afbf65-c8bb-4d81-866e-65b1b83daf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e65e6-628c-46cc-a434-65278b09fd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112e65e6-628c-46cc-a434-65278b09fd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-340371608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b09703cd6455f9a469934c653916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:34Z,use_quota=True,user_id='df919e09644b4db681f052c28d76d9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bbc41f-98e3-4c79-b3ef-4db17484c1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bbc41f-98e3-4c79-b3ef-4db17484c1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2681fd37-cfc9-4444-9316-20f33a2c91e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2681fd37-cfc9-4444-9316-20f33a2c91e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa', 'volume_name': 'volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cad8e7-6164-481f-98f4-d153e883a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cad8e7-6164-481f-98f4-d153e883a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f072753-713b-4c27-8bac-3431e7167725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Volume ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa', 'volume_size': 1} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-340371608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b09703cd6455f9a469934c653916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:34Z,use_quota=True,user_id='df919e09644b4db681f052c28d76d9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Creating volume ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:33 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa 1073741824 Jul 16 12:51:33 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:34 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa 1073741824" returned: 0 in 0.537s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:34 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa Jul 16 12:51:34 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:34 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f072753-713b-4c27-8bac-3431e7167725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b749b-4112-4a68-a72a-5ad648f335fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Volume volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa (ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa): created successfully Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53b749b-4112-4a68-a72a-5ad648f335fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Flow 'volume_create_manager' (a0afbf65-c8bb-4d81-866e-65b1b83daf0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-260a020c-1894-4957-b702-410e3f7fe8d0 tempest-VolumesTransfersTest-323612404 None] Created volume successfully. Jul 16 12:51:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f7c4213b-a3b6-444a-9522-d7452dfaf2cc tempest-VolumesTransfersTest-1337343441 None] Transfer volume completed successfully. Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Acquiring lock "cinder-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "cinder-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Acquiring lock "cinder-quobyte-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "cinder-quobyte-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478a088-8eb1-4cb8-a156-bdf1de25e0b3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:51:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:37 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa Jul 16 12:51:37 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:38 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" returned: 0 in 0.526s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:38 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa Jul 16 12:51:38 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:38 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "cinder-quobyte-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa" released by "delete_volume" :: held 1.034s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Created reservations ['fdc24f91-5556-4b2e-b38d-a8a08ac8c786', 'f32e232d-c534-4e43-9bf7-02ecf34cb71b', 'd4c5fb4b-bfdd-414b-897c-cabcda801051', '7513a2b6-bf6a-48d2-aadd-a978292fcf26'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:38 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:51:38 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:38 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.319s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:51:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Deleted volume successfully. Jul 16 12:51:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82b244a8-6994-4a7c-abd9-bfe32ffe679d tempest-VolumesTransfersTest-680298295 None] Lock "cinder-ec8ba05a-caf6-4131-b9e6-b7bc98ad33fa-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Flow 'volume_create_manager' (60ac9680-cd0a-451a-b875-13aaeab7be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494271b0-a21a-40fb-8cd7-9757dd601a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494271b0-a21a-40fb-8cd7-9757dd601a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1609118011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1449ef2-24f7-4587-92fd-e930d45a5ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b09703cd6455f9a469934c653916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:40Z,use_quota=True,user_id='df919e09644b4db681f052c28d76d9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c156f2c8-2363-4dd9-b615-71849b7b6f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c156f2c8-2363-4dd9-b615-71849b7b6f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f7ad0-92bf-4890-9ea1-a50f7a5293b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f7ad0-92bf-4890-9ea1-a50f7a5293b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1449ef2-24f7-4587-92fd-e930d45a5ea6', 'volume_name': 'volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4faa4f1-d555-42eb-8942-174aba73c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4faa4f1-d555-42eb-8942-174aba73c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3162da-0c52-4c3b-8751-3a834bc36f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Volume f1449ef2-24f7-4587-92fd-e930d45a5ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6', 'volume_size': 1} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1609118011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1449ef2-24f7-4587-92fd-e930d45a5ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2b09703cd6455f9a469934c653916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:40Z,use_quota=True,user_id='df919e09644b4db681f052c28d76d9c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Creating volume f1449ef2-24f7-4587-92fd-e930d45a5ea6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:40 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:40 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 1073741824 Jul 16 12:51:40 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:41 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 1073741824" returned: 0 in 0.505s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:41 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 Jul 16 12:51:41 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:41 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae3162da-0c52-4c3b-8751-3a834bc36f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d835230-28f1-4fca-8a01-3335c4ccde80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Volume volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 (f1449ef2-24f7-4587-92fd-e930d45a5ea6): created successfully Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d835230-28f1-4fca-8a01-3335c4ccde80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Flow 'volume_create_manager' (60ac9680-cd0a-451a-b875-13aaeab7be0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5be7a55a-9ea5-499d-88ac-183b329e722f tempest-VolumesTransfersTest-323612404 None] Created volume successfully. Jul 16 12:51:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Acquiring lock "cinder-f1449ef2-24f7-4587-92fd-e930d45a5ea6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "cinder-f1449ef2-24f7-4587-92fd-e930d45a5ea6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Acquiring lock "cinder-quobyte-f1449ef2-24f7-4587-92fd-e930d45a5ea6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "cinder-quobyte-f1449ef2-24f7-4587-92fd-e930d45a5ea6" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616ba91-1fc4-4abc-acad-b434515013c1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:43 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 Jul 16 12:51:43 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:43 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6" returned: 0 in 0.534s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:43 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6 Jul 16 12:51:43 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:43 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f1449ef2-24f7-4587-92fd-e930d45a5ea6" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "cinder-quobyte-f1449ef2-24f7-4587-92fd-e930d45a5ea6" released by "delete_volume" :: held 1.018s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Created reservations ['9562d37c-7b6c-4f1d-a8eb-d07649efa038', 'db56d2d7-e054-4079-84ba-ab323fcfdce1', '742069fa-ddfc-4c8d-96d0-0400e0942a14', '5824a7d5-c5ea-4d28-9ecd-a431777de51f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-344e6a01-83da-4c20-9427-52795c3856ed req-d67ef904-5da5-4a35-98b8-54b1afb72716 tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-344e6a01-83da-4c20-9427-52795c3856ed req-d67ef904-5da5-4a35-98b8-54b1afb72716 tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:44 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:51:44 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-344e6a01-83da-4c20-9427-52795c3856ed req-d67ef904-5da5-4a35-98b8-54b1afb72716 tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-344e6a01-83da-4c20-9427-52795c3856ed req-d67ef904-5da5-4a35-98b8-54b1afb72716 tempest-ServerActionsTestOtherA-999385629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a43db5e-58da-4593-bfad-d99a104d1b57', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:51:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-344e6a01-83da-4c20-9427-52795c3856ed req-d67ef904-5da5-4a35-98b8-54b1afb72716 tempest-ServerActionsTestOtherA-999385629 None] attachment_update completed successfully. Jul 16 12:51:44 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:51:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Deleted volume successfully. Jul 16 12:51:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-904f721a-18ce-4def-b767-09495bb3fd6f tempest-VolumesTransfersTest-680298295 None] Lock "cinder-f1449ef2-24f7-4587-92fd-e930d45a5ea6-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1c541218-a4ce-4085-ad46-ef8c9d53def7 tempest-ServerActionsTestOtherA-999385629 None] Terminate volume connection completed successfully. Jul 16 12:51:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1c541218-a4ce-4085-ad46-ef8c9d53def7 tempest-ServerActionsTestOtherA-999385629 None] Deleting attachment 7a43db5e-58da-4593-bfad-d99a104d1b57. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:51:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1d676a6b-e4c0-4335-a7b6-8530c16ebb72 tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1d676a6b-e4c0-4335-a7b6-8530c16ebb72 tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1d676a6b-e4c0-4335-a7b6-8530c16ebb72 tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1d676a6b-e4c0-4335-a7b6-8530c16ebb72 tempest-ServerActionsTestOtherA-999385629 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5137f560-49d3-4439-9915-0246a1589b7f', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:51:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-b1f76758-b2f2-418a-aee2-f95df1a72cba req-1d676a6b-e4c0-4335-a7b6-8530c16ebb72 tempest-ServerActionsTestOtherA-999385629 None] attachment_update completed successfully. Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Flow 'volume_create_manager' (7dd4f682-6b74-4a22-8350-3e978ccb4e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d4fbc2-c384-447c-8b7c-9e4fff244b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d4fbc2-c384-447c-8b7c-9e4fff244b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-3916338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74545072-8893-46c2-91a0-ac9c958655c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2680918b82f94528bb0d258900281cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:53Z,use_quota=True,user_id='28a8d95b3b1247da82627468ead77d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1809a364-ed22-4194-923f-bea7139121e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1809a364-ed22-4194-923f-bea7139121e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d1468c-a045-4627-8b0a-fa945bcea416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d1468c-a045-4627-8b0a-fa945bcea416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74545072-8893-46c2-91a0-ac9c958655c7', 'volume_name': 'volume-74545072-8893-46c2-91a0-ac9c958655c7', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45eaf75-b14f-441c-a0a3-1f937920b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45eaf75-b14f-441c-a0a3-1f937920b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab384391-ad9f-4fc5-b835-06081b1cb47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Volume 74545072-8893-46c2-91a0-ac9c958655c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74545072-8893-46c2-91a0-ac9c958655c7', 'volume_size': 2} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-3916338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74545072-8893-46c2-91a0-ac9c958655c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2680918b82f94528bb0d258900281cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:53Z,use_quota=True,user_id='28a8d95b3b1247da82627468ead77d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Creating volume 74545072-8893-46c2-91a0-ac9c958655c7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:52 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 2147483648 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:52 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 2147483648 Jul 16 12:51:52 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:53 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 2147483648" returned: 0 in 0.675s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:53 devstack sudo[92558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 Jul 16 12:51:53 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:53 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab384391-ad9f-4fc5-b835-06081b1cb47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74545072-8893-46c2-91a0-ac9c958655c7', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf3f13a-b8f0-4ff1-b79c-75f4b6cb14a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:53 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Volume volume-74545072-8893-46c2-91a0-ac9c958655c7 (74545072-8893-46c2-91a0-ac9c958655c7): created successfully Jul 16 12:51:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf3f13a-b8f0-4ff1-b79c-75f4b6cb14a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Flow 'volume_create_manager' (7dd4f682-6b74-4a22-8350-3e978ccb4e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cbec711c-d003-401d-b748-b9c41efb9cdd tempest-VolumesCloneNegativeTest-1886427178 None] Created volume successfully. Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Acquiring lock "cinder-74545072-8893-46c2-91a0-ac9c958655c7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "cinder-74545072-8893-46c2-91a0-ac9c958655c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Acquiring lock "cinder-quobyte-74545072-8893-46c2-91a0-ac9c958655c7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "cinder-quobyte-74545072-8893-46c2-91a0-ac9c958655c7" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2183d497-3451-444e-bf8a-75ed6c54b59c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:55 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 Jul 16 12:51:55 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (6015415e-fcfb-4da7-847a-ffd730888407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34049bfe-bfff-4552-be91-aef001295106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34049bfe-bfff-4552-be91-aef001295106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1069045204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252a7abb-0d8f-4001-9db4-0f8efe9b899d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:56Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc39b076-49d1-4803-9348-ca0faac4ac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc39b076-49d1-4803-9348-ca0faac4ac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc2e1f8-ba85-44dd-bcab-0563beb360f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc2e1f8-ba85-44dd-bcab-0563beb360f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252a7abb-0d8f-4001-9db4-0f8efe9b899d', 'volume_name': 'volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8bfeee-7f81-433a-90b6-4f7502676a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b8bfeee-7f81-433a-90b6-4f7502676a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d183d1-6e97-4b2f-b909-9e5e542c12f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Volume 252a7abb-0d8f-4001-9db4-0f8efe9b899d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d', 'volume_size': 1} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1069045204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252a7abb-0d8f-4001-9db4-0f8efe9b899d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:51:56Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Creating volume 252a7abb-0d8f-4001-9db4-0f8efe9b899d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:51:55 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:51:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:55 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d 1073741824 Jul 16 12:51:55 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:56 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7" returned: 0 in 0.742s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:56 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7 Jul 16 12:51:56 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:56 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-74545072-8893-46c2-91a0-ac9c958655c7" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "cinder-quobyte-74545072-8893-46c2-91a0-ac9c958655c7" released by "delete_volume" :: held 1.234s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:56 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d 1073741824" returned: 0 in 0.762s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Created reservations ['22f6510c-4fe0-4881-8e82-6885044af027', 'dcf243d9-32b3-4ece-aa66-631136f50aaa', '85ad2976-a7e0-42f5-983c-980e8ac28a10', '2d514ead-6570-4a31-a763-cca55c36c2b5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:56 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d Jul 16 12:51:56 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:51:56 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:51:56 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:51:57 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d183d1-6e97-4b2f-b909-9e5e542c12f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db80db-3687-4c69-84f2-7cb818457322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:51:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Volume volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d (252a7abb-0d8f-4001-9db4-0f8efe9b899d): created successfully Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db80db-3687-4c69-84f2-7cb818457322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (6015415e-fcfb-4da7-847a-ffd730888407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:51:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2fbe3972-1614-4249-9bf7-f8a2c1bee3ef tempest-AttachVolumeTestJSON-292988874 None] Created volume successfully. Jul 16 12:51:57 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:51:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Deleted volume successfully. Jul 16 12:51:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9c954e5b-cb08-4bdc-843a-0afaf0975c3f tempest-VolumesCloneNegativeTest-1886427178 None] Lock "cinder-74545072-8893-46c2-91a0-ac9c958655c7-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:51:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7872d982-c7f6-4399-b630-cc93a463f67d req-14ddfcd6-a934-411b-8b41-c07c6f24282a tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:51:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7872d982-c7f6-4399-b630-cc93a463f67d req-14ddfcd6-a934-411b-8b41-c07c6f24282a tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:51:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7872d982-c7f6-4399-b630-cc93a463f67d req-14ddfcd6-a934-411b-8b41-c07c6f24282a tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:51:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-7872d982-c7f6-4399-b630-cc93a463f67d req-14ddfcd6-a934-411b-8b41-c07c6f24282a tempest-AttachVolumeTestJSON-292988874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e79ca4b-cdf8-4bba-823a-dfca63a9096d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:51:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-7872d982-c7f6-4399-b630-cc93a463f67d req-14ddfcd6-a934-411b-8b41-c07c6f24282a tempest-AttachVolumeTestJSON-292988874 None] attachment_update completed successfully. Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (3e8df382-2d63-4805-bf39-65f225dab237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16f47ab-b140-4a1e-b986-7b15700051f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16f47ab-b140-4a1e-b986-7b15700051f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1491441048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dc3c43-45ac-4128-9355-557d753d400a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:02Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaae7e4-061e-46ae-9be5-8c0e9e1c1f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaae7e4-061e-46ae-9be5-8c0e9e1c1f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee10420f-a9bc-461f-9958-1f5028cbcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee10420f-a9bc-461f-9958-1f5028cbcb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dc3c43-45ac-4128-9355-557d753d400a', 'volume_name': 'volume-90dc3c43-45ac-4128-9355-557d753d400a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42bb206-0fbf-4b25-8d9a-6b5a8da02a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42bb206-0fbf-4b25-8d9a-6b5a8da02a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba58dcfe-0679-4bc7-9521-9a6550fef03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Volume 90dc3c43-45ac-4128-9355-557d753d400a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dc3c43-45ac-4128-9355-557d753d400a', 'volume_size': 1} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1491441048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dc3c43-45ac-4128-9355-557d753d400a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11b2bab560994401b63065ef3d20defe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:02Z,use_quota=True,user_id='7050b3076a0a4499a9e86e6e656cf352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Creating volume 90dc3c43-45ac-4128-9355-557d753d400a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:02 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:02 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a 1073741824 Jul 16 12:52:02 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:02 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a 1073741824" returned: 0 in 0.645s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:02 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a Jul 16 12:52:02 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:03 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba58dcfe-0679-4bc7-9521-9a6550fef03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dc3c43-45ac-4128-9355-557d753d400a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c46649-a169-4738-bd14-aa37449a2189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Volume volume-90dc3c43-45ac-4128-9355-557d753d400a (90dc3c43-45ac-4128-9355-557d753d400a): created successfully Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c46649-a169-4738-bd14-aa37449a2189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Flow 'volume_create_manager' (3e8df382-2d63-4805-bf39-65f225dab237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee67dff8-b1e8-4310-be9e-a799e052109f tempest-AttachVolumeTestJSON-292988874 None] Created volume successfully. Jul 16 12:52:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b2d5c8b5-5da2-4137-b044-23721c8af472 req-6f85d987-ca3b-4a64-b568-475be1dd6ba1 tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b2d5c8b5-5da2-4137-b044-23721c8af472 req-6f85d987-ca3b-4a64-b568-475be1dd6ba1 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b2d5c8b5-5da2-4137-b044-23721c8af472 req-6f85d987-ca3b-4a64-b568-475be1dd6ba1 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-b2d5c8b5-5da2-4137-b044-23721c8af472 req-6f85d987-ca3b-4a64-b568-475be1dd6ba1 tempest-AttachVolumeTestJSON-292988874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-90dc3c43-45ac-4128-9355-557d753d400a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b14fa27-9836-4eda-98ae-ec165ad8fa16', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:52:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-b2d5c8b5-5da2-4137-b044-23721c8af472 req-6f85d987-ca3b-4a64-b568-475be1dd6ba1 tempest-AttachVolumeTestJSON-292988874 None] attachment_update completed successfully. Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Flow 'volume_create_manager' (441b6e2f-ebb2-499a-889a-0ed1fc099916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f38c74-cec8-42cf-a448-46b991bfbdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f38c74-cec8-42cf-a448-46b991bfbdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-83546493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2ac117-53a9-45c1-8f82-b3207e15ff3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ade4c11214dc9a2ab113a9576d6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:06Z,use_quota=True,user_id='7e71dafe5ef04652bb67bb743f661f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01507c27-896a-49ef-8146-6a7597fa31cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01507c27-896a-49ef-8146-6a7597fa31cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c19f4c-7f22-40f0-8a82-c773d7e08d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c19f4c-7f22-40f0-8a82-c773d7e08d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2ac117-53a9-45c1-8f82-b3207e15ff3f', 'volume_name': 'volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d7aa0-3630-4937-a6b0-1c829fd24211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3d7aa0-3630-4937-a6b0-1c829fd24211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc82fe-a6f0-47f2-8844-8c0a518ec7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Volume dc2ac117-53a9-45c1-8f82-b3207e15ff3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f', 'volume_size': 2} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-83546493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2ac117-53a9-45c1-8f82-b3207e15ff3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09ade4c11214dc9a2ab113a9576d6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:06Z,use_quota=True,user_id='7e71dafe5ef04652bb67bb743f661f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Creating volume dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f 2147483648 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:06 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f 2147483648 Jul 16 12:52:06 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:07 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f 2147483648" returned: 0 in 1.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:07 devstack sudo[92766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f Jul 16 12:52:07 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:08 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" returned: 0 in 0.537s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc82fe-a6f0-47f2-8844-8c0a518ec7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a0ae44-833b-48ea-b6b9-ac682c08ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Volume volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f (dc2ac117-53a9-45c1-8f82-b3207e15ff3f): created successfully Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a0ae44-833b-48ea-b6b9-ac682c08ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Flow 'volume_create_manager' (441b6e2f-ebb2-499a-889a-0ed1fc099916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8b5e4174-ac1b-4c07-85ac-27310b53f000 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Created volume successfully. Jul 16 12:52:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-c428b951-e09a-4012-a83e-9ffe08c77564 req-20683dfa-d797-4a69-9fba-02fca7e34026 tempest-AttachVolumeTestJSON-292988874 None] Terminate volume connection completed successfully. Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-c428b951-e09a-4012-a83e-9ffe08c77564 req-20683dfa-d797-4a69-9fba-02fca7e34026 tempest-AttachVolumeTestJSON-292988874 None] Deleting attachment 3e79ca4b-cdf8-4bba-823a-dfca63a9096d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:08 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:08 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:09 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Creating offline snapshot dc85fe30-6314-429a-9e85-f39a80cbb238 of volume dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4409872-62db-41d3-836b-82d255d5aff4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:09 devstack sudo[92793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f Jul 16 12:52:09 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:10 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" returned: 0 in 0.608s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:10 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 2G Jul 16 12:52:10 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-7c82522e-fc50-4542-a01a-6b999283f590 req-05257c82-e280-4bd4-992f-315fc0beac82 tempest-AttachVolumeTestJSON-292988874 None] Terminate volume connection completed successfully. Jul 16 12:52:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-7c82522e-fc50-4542-a01a-6b999283f590 req-05257c82-e280-4bd4-992f-315fc0beac82 tempest-AttachVolumeTestJSON-292988874 None] Deleting attachment 4b14fa27-9836-4eda-98ae-ec165ad8fa16. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:52:10 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 2G" returned: 0 in 0.590s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:10 devstack sudo[92810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 Jul 16 12:52:10 devstack sudo[92810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:11 devstack sudo[92810]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 is being set with open permissions: ugo+rw Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:11 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 Jul 16 12:52:11 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:11 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:11 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info Jul 16 12:52:11 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:11 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info is being set with open permissions: ugo+rw Jul 16 12:52:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:11 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info Jul 16 12:52:11 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:12 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.info" returned: 0 in 0.518s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30b5d09c-d5cf-4f08-b95d-e0f35839e2d6 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Create snapshot completed successfully Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "cinder-dc85fe30-6314-429a-9e85-f39a80cbb238-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-dc85fe30-6314-429a-9e85-f39a80cbb238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "cinder-quobyte-dc85fe30-6314-429a-9e85-f39a80cbb238" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc85fe30-6314-429a-9e85-f39a80cbb238" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Deleting offline snapshot dc85fe30-6314-429a-9e85-f39a80cbb238 of volume dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] snapshot_file for this snap is: volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbcff67-9e0f-4066-bcf0-d283eedb834c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:13 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 Jul 16 12:52:13 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:13 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238" returned: 0 in 0.498s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[29688d70-7708-478a-8aaa-8ceacff45c02]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:13 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f Jul 16 12:52:13 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:14 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" returned: 0 in 0.451s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:14 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 Jul 16 12:52:14 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:14 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238" returned: 0 in 0.368s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:14 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238 Jul 16 12:52:14 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:14 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f.dc85fe30-6314-429a-9e85-f39a80cbb238" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc85fe30-6314-429a-9e85-f39a80cbb238" released by "_delete_snapshot" :: held 1.746s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" released by "delete_snapshot" :: held 1.785s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Created reservations ['d6c8a10a-28c9-4f1a-b0e7-90ed7431a4f3', 'ad0be91d-2c70-4a2d-ac03-84ae61da24ab', '48ab954f-ef16-451a-ae6b-aecd620c2bd4', '5829dc17-acba-4c36-b6e5-65e8f5c265ee'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Delete snapshot completed successfully. Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79c7697b-c0d4-4bdb-8169-7c8bac5fb823 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-dc85fe30-6314-429a-9e85-f39a80cbb238-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "cinder-dc2ac117-53a9-45c1-8f82-b3207e15ff3f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-dc2ac117-53a9-45c1-8f82-b3207e15ff3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aff694-a901-4466-ae91-da5057a57d3b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:15 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f Jul 16 12:52:15 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:15 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:16 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f Jul 16 12:52:16 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-90dc3c43-45ac-4128-9355-557d753d400a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-90dc3c43-45ac-4128-9355-557d753d400a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-quobyte-90dc3c43-45ac-4128-9355-557d753d400a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-90dc3c43-45ac-4128-9355-557d753d400a" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07444f5-19fd-4827-ba4d-79566922c444]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:16 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:16 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a Jul 16 12:52:16 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-quobyte-dc2ac117-53a9-45c1-8f82-b3207e15ff3f" released by "delete_volume" :: held 0.945s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Created reservations ['3ef95346-5ebe-4a97-ab9f-f8205b76867f', '5bb8b5cf-d4a3-4e6f-85d1-221f46f40c22', '703447c6-63ef-481b-a549-6681ee9f9325', '8394006e-5102-4906-a3dc-ba4047d51af5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:16 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:16 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:16 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a" returned: 0 in 0.513s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:16 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a Jul 16 12:52:16 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:16 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Deleted volume successfully. Jul 16 12:52:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a8006e7c-bdf0-469c-a02e-88a69ecb3433 tempest-VolumesSnapshotNegativeTestJSON-458552647 None] Lock "cinder-dc2ac117-53a9-45c1-8f82-b3207e15ff3f-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:17 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-90dc3c43-45ac-4128-9355-557d753d400a" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-90dc3c43-45ac-4128-9355-557d753d400a" released by "delete_volume" :: held 0.933s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Created reservations ['8e7b1479-95fe-4a94-8b37-c30b4b7f38e4', 'c5fa8584-308b-4188-a4a4-998a0b98b5f7', '33798bfb-2fab-4f59-8d15-5f75a59ccf06', '5674b520-6d72-4b39-8054-9afca4591e2e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:17 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:17 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:17 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Deleted volume successfully. Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=89,cinder:UPDATE=93,cinder:INSERT=22,cinder:DELETE=10 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:52:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0aa1cf-1812-4800-b4fe-1cdc7212fa9b tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-90dc3c43-45ac-4128-9355-557d753d400a-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-252a7abb-0d8f-4001-9db4-0f8efe9b899d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-252a7abb-0d8f-4001-9db4-0f8efe9b899d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-quobyte-252a7abb-0d8f-4001-9db4-0f8efe9b899d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-252a7abb-0d8f-4001-9db4-0f8efe9b899d" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[78893729-71d2-4bb8-91b2-fd44b1bcc337]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-75f6ee71-716c-417e-baf1-0248df49a5a4 req-a9b69e33-548e-4d38-8bbd-85be579e5c07 tempest-ServerActionsTestOtherA-999385629 None] Terminate volume connection completed successfully. Jul 16 12:52:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-75f6ee71-716c-417e-baf1-0248df49a5a4 req-a9b69e33-548e-4d38-8bbd-85be579e5c07 tempest-ServerActionsTestOtherA-999385629 None] Deleting attachment 5137f560-49d3-4439-9915-0246a1589b7f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:52:18 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d Jul 16 12:52:18 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:19 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:19 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d Jul 16 12:52:19 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:19 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-252a7abb-0d8f-4001-9db4-0f8efe9b899d" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-252a7abb-0d8f-4001-9db4-0f8efe9b899d" released by "delete_volume" :: held 0.871s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Created reservations ['6cbf4202-9b1c-45d5-ae32-3887dcbf1c85', '573e4cea-3ffc-41eb-9d2e-b0a68d87c20b', 'e4a0afee-1a2b-4ef4-b4c3-be371567d58e', 'fd4c3045-c983-440f-8021-9e1d30841515'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:19 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:19 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:20 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:20 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Deleted volume successfully. Jul 16 12:52:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214b4728-46a5-4a9c-a10d-444e168eb1bd tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-252a7abb-0d8f-4001-9db4-0f8efe9b899d-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-bd1bffac-7659-4656-98cf-8db53fe57f79-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-bd1bffac-7659-4656-98cf-8db53fe57f79-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "cinder-quobyte-bd1bffac-7659-4656-98cf-8db53fe57f79" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-bd1bffac-7659-4656-98cf-8db53fe57f79" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6110b305-89c1-4009-bb3f-c69e381ea84a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:21 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 Jul 16 12:52:21 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:22 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79" returned: 0 in 0.671s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:22 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79 Jul 16 12:52:22 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:22 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-bd1bffac-7659-4656-98cf-8db53fe57f79" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-quobyte-bd1bffac-7659-4656-98cf-8db53fe57f79" released by "delete_volume" :: held 1.053s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Created reservations ['3252cc11-d477-4194-88fa-fa75f8e47dfe', 'f1025cae-e97d-4bee-8cc6-f945cf7c33c0', '823348ab-913a-404f-8b39-e5d95c581d56', '3acdf588-55a8-4b6a-ad0e-207fecca1b85'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:22 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:22 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:22 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Deleted volume successfully. Jul 16 12:52:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66666a7-6392-4957-97c6-ec9553e812e1 tempest-AttachVolumeTestJSON-292988874 None] Lock "cinder-bd1bffac-7659-4656-98cf-8db53fe57f79-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "cinder-32ea4c43-6165-4278-9b39-4d0cfa4ef057-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "cinder-32ea4c43-6165-4278-9b39-4d0cfa4ef057-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "cinder-quobyte-32ea4c43-6165-4278-9b39-4d0cfa4ef057" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "cinder-quobyte-32ea4c43-6165-4278-9b39-4d0cfa4ef057" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed1c26-0962-4b2e-b56a-b72481ce6fb2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:24 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 Jul 16 12:52:24 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:24 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:24 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057 Jul 16 12:52:24 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:24 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-32ea4c43-6165-4278-9b39-4d0cfa4ef057" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "cinder-quobyte-32ea4c43-6165-4278-9b39-4d0cfa4ef057" released by "delete_volume" :: held 0.720s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Created reservations ['a27530de-8b18-4c7b-b275-f5033c20fd78', 'b415125e-d588-4d7f-80bb-7c68c1cdf0d1', '313eda2e-d0b4-40ba-811f-89e074d2fd33', 'd29dd6b3-6e1e-45fc-be10-b3f284a8a5d1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:24 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:24 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:25 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Deleted volume successfully. Jul 16 12:52:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c38b755-a96f-4870-a269-9ed0f911f54e tempest-ServerActionsTestOtherA-999385629 None] Lock "cinder-32ea4c43-6165-4278-9b39-4d0cfa4ef057-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=93,cinder:UPDATE=92,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Flow 'volume_create_manager' (970f4a33-d5b6-4b64-8c00-f79ff8c80a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390f841a-5556-4d87-9b86-f220bdfefb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390f841a-5556-4d87-9b86-f220bdfefb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-432616253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedd5910-1cb9-406e-b074-b006d14943ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e3f8466da54ce99fe6e05a37cd7f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:34Z,use_quota=True,user_id='8bd0e9fbc10c4767a06766e50ca4ece4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80271228-11fe-4160-aa77-7986060b2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80271228-11fe-4160-aa77-7986060b2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7b4974-9b4b-4e38-a24d-34955b642539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7b4974-9b4b-4e38-a24d-34955b642539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedd5910-1cb9-406e-b074-b006d14943ca', 'volume_name': 'volume-eedd5910-1cb9-406e-b074-b006d14943ca', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ce57ed-344d-4994-8034-53e9c3f63628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ce57ed-344d-4994-8034-53e9c3f63628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e294b76-fe4d-4495-8e05-5b79f34430ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Volume eedd5910-1cb9-406e-b074-b006d14943ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedd5910-1cb9-406e-b074-b006d14943ca', 'volume_size': 1} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-432616253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedd5910-1cb9-406e-b074-b006d14943ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e3f8466da54ce99fe6e05a37cd7f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:34Z,use_quota=True,user_id='8bd0e9fbc10c4767a06766e50ca4ece4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Creating volume eedd5910-1cb9-406e-b074-b006d14943ca {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:34 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca 1073741824 Jul 16 12:52:34 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:35 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca 1073741824" returned: 0 in 0.615s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:35 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca Jul 16 12:52:35 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:35 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e294b76-fe4d-4495-8e05-5b79f34430ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedd5910-1cb9-406e-b074-b006d14943ca', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4316a7b-d319-466e-b455-02b489c491f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Volume volume-eedd5910-1cb9-406e-b074-b006d14943ca (eedd5910-1cb9-406e-b074-b006d14943ca): created successfully Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4316a7b-d319-466e-b455-02b489c491f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Flow 'volume_create_manager' (970f4a33-d5b6-4b64-8c00-f79ff8c80a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c9746951-853e-4d8e-aaab-473caa1d56d7 tempest-AttachVolumeShelveTestJSON-2025376655 None] Created volume successfully. Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (7c4eaf63-56fa-4b41-ac53-4c01e73897e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f78c0af-2ccb-4a15-8ff6-9c3ba7aa2cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f78c0af-2ccb-4a15-8ff6-9c3ba7aa2cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-25366541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e510ba2e-ae8a-46cf-838b-8b887283b6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:36Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc62b71-ca0a-449c-b084-2849ddee622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc62b71-ca0a-449c-b084-2849ddee622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e306f1c5-8734-4985-a4f3-bdf3153f5de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e306f1c5-8734-4985-a4f3-bdf3153f5de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e510ba2e-ae8a-46cf-838b-8b887283b6f9', 'volume_name': 'volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7c7b1-33af-4809-88f3-d633974f087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7c7b1-33af-4809-88f3-d633974f087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1a7650-bec9-4b4c-9b5a-9a9f4d3b67d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Volume e510ba2e-ae8a-46cf-838b-8b887283b6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9', 'volume_size': 1} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-25366541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e510ba2e-ae8a-46cf-838b-8b887283b6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:36Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Creating volume e510ba2e-ae8a-46cf-838b-8b887283b6f9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:36 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 1073741824 Jul 16 12:52:36 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:36 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 1073741824" returned: 0 in 0.567s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:36 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 Jul 16 12:52:36 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:37 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e1a7650-bec9-4b4c-9b5a-9a9f4d3b67d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33906d-c719-4384-ad08-79bf1a8b158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Volume volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 (e510ba2e-ae8a-46cf-838b-8b887283b6f9): created successfully Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc33906d-c719-4384-ad08-79bf1a8b158b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (7c4eaf63-56fa-4b41-ac53-4c01e73897e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f8c93835-dde9-4bae-a04c-f5518e34a414 tempest-VolumesTestJSON-1165777402 None] Created volume successfully. Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (724e5458-fa41-4b99-b418-c822168616d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cf9092-98dc-40a7-a01d-b9fed0f199e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25cf9092-98dc-40a7-a01d-b9fed0f199e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376903003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1042169f-7b06-486b-986c-523a8920840a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:39Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b40546-57fa-4193-9242-8c138048ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b40546-57fa-4193-9242-8c138048ae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdeb4c5-d9fb-445b-8765-9a311340be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdeb4c5-d9fb-445b-8765-9a311340be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1042169f-7b06-486b-986c-523a8920840a', 'volume_name': 'volume-1042169f-7b06-486b-986c-523a8920840a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e48212-9cf5-4594-9f14-a73e4e499d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57e48212-9cf5-4594-9f14-a73e4e499d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78f34ed-f9d6-4f7c-b991-8e6893c364ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Volume 1042169f-7b06-486b-986c-523a8920840a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1042169f-7b06-486b-986c-523a8920840a', 'volume_size': 1} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-376903003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1042169f-7b06-486b-986c-523a8920840a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:39Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Creating volume 1042169f-7b06-486b-986c-523a8920840a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:39 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a 1073741824 Jul 16 12:52:39 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:39 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a 1073741824" returned: 0 in 0.692s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:39 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a Jul 16 12:52:39 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:40 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78f34ed-f9d6-4f7c-b991-8e6893c364ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1042169f-7b06-486b-986c-523a8920840a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1148b-5ae0-4b01-a2c0-7b5aff5f2c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Volume volume-1042169f-7b06-486b-986c-523a8920840a (1042169f-7b06-486b-986c-523a8920840a): created successfully Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1148b-5ae0-4b01-a2c0-7b5aff5f2c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (724e5458-fa41-4b99-b418-c822168616d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1855c14f-ebae-4e23-aa5c-a9b4491d0c0a tempest-VolumesTestJSON-1165777402 None] Created volume successfully. Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (64cccf3e-dfd8-4086-be8e-5f368ed0b34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8dd242-27aa-4187-ac4c-1e5091c05985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8dd242-27aa-4187-ac4c-1e5091c05985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-602510035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03caa93c-de34-41f3-b4dd-522b9675749c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:42Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4112014d-f0ee-414f-b7d2-3c570bc28c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4112014d-f0ee-414f-b7d2-3c570bc28c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3d80df-090f-4070-bdf6-cfc67bbe0f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3d80df-090f-4070-bdf6-cfc67bbe0f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03caa93c-de34-41f3-b4dd-522b9675749c', 'volume_name': 'volume-03caa93c-de34-41f3-b4dd-522b9675749c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e35f8e6-bb44-4393-8767-39c663777e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e35f8e6-bb44-4393-8767-39c663777e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908bcb58-3dda-4b93-bba8-7b7206bacaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Volume 03caa93c-de34-41f3-b4dd-522b9675749c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03caa93c-de34-41f3-b4dd-522b9675749c', 'volume_size': 1} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-602510035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03caa93c-de34-41f3-b4dd-522b9675749c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ba98ca50ac7247999ce2307f2e48f9f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:42Z,use_quota=True,user_id='de5885317362435db3e32109519fc473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Creating volume 03caa93c-de34-41f3-b4dd-522b9675749c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:42 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c 1073741824 Jul 16 12:52:42 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:42 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c 1073741824" returned: 0 in 0.684s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:42 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c Jul 16 12:52:42 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:43 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908bcb58-3dda-4b93-bba8-7b7206bacaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03caa93c-de34-41f3-b4dd-522b9675749c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e01083-46c3-4c10-b3e2-012952574b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Volume volume-03caa93c-de34-41f3-b4dd-522b9675749c (03caa93c-de34-41f3-b4dd-522b9675749c): created successfully Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e01083-46c3-4c10-b3e2-012952574b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Flow 'volume_create_manager' (64cccf3e-dfd8-4086-be8e-5f368ed0b34a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ebde0ade-9a64-4e63-bacb-fc4803de2498 tempest-VolumesTestJSON-1165777402 None] Created volume successfully. Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Flow 'volume_create_manager' (5de860f5-c45e-43d0-918e-f6c56f91b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7010a8d4-ae8c-448d-8be5-77d19d2defb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7010a8d4-ae8c-448d-8be5-77d19d2defb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1851371308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf0c50e-f984-4710-b222-9cf662e6587c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437ec441ff434f5c9a1e5806a21ef86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:45Z,use_quota=True,user_id='60e1b95ceb22406eac15af895cbc632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca47ee8-84bd-41ce-a0c6-b5d31354b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca47ee8-84bd-41ce-a0c6-b5d31354b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0820d4d-207c-46a3-bbbf-08ee4e8f6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0820d4d-207c-46a3-bbbf-08ee4e8f6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf0c50e-f984-4710-b222-9cf662e6587c', 'volume_name': 'volume-3bf0c50e-f984-4710-b222-9cf662e6587c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c5c45f-c9b7-4415-ab0f-2071fb39cadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c5c45f-c9b7-4415-ab0f-2071fb39cadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529665d-8717-4d25-8692-f3ac66c75ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:45 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume 3bf0c50e-f984-4710-b222-9cf662e6587c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf0c50e-f984-4710-b222-9cf662e6587c', 'volume_size': 1} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1851371308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf0c50e-f984-4710-b222-9cf662e6587c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437ec441ff434f5c9a1e5806a21ef86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:45Z,use_quota=True,user_id='60e1b95ceb22406eac15af895cbc632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Creating volume 3bf0c50e-f984-4710-b222-9cf662e6587c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:45 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:45 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c 1073741824 Jul 16 12:52:45 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-03caa93c-de34-41f3-b4dd-522b9675749c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-03caa93c-de34-41f3-b4dd-522b9675749c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-quobyte-03caa93c-de34-41f3-b4dd-522b9675749c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-03caa93c-de34-41f3-b4dd-522b9675749c" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc4ecc3-6d7a-4b0e-93c5-9f47f957bc77]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:46 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c Jul 16 12:52:46 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:46 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c 1073741824" returned: 0 in 0.771s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Flow 'volume_create_manager' (927e6bf5-7c1a-4d26-ba5a-2ad47fecd7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddec9772-bb98-466e-b154-a86ae61d5537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddec9772-bb98-466e-b154-a86ae61d5537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2138513333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67599d1-3102-4cb1-84f0-308f6270e8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437ec441ff434f5c9a1e5806a21ef86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:46Z,use_quota=True,user_id='60e1b95ceb22406eac15af895cbc632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5bd6fb-c70a-4935-8e54-74b8d49ff43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5bd6fb-c70a-4935-8e54-74b8d49ff43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99e6c1e-2480-4479-ae1c-6bab0e966059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99e6c1e-2480-4479-ae1c-6bab0e966059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c67599d1-3102-4cb1-84f0-308f6270e8d8', 'volume_name': 'volume-c67599d1-3102-4cb1-84f0-308f6270e8d8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e8ba10-b3b4-4079-a3da-377d68d00b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e8ba10-b3b4-4079-a3da-377d68d00b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d5a64c-4cfc-456f-b5c8-247cbf7a57e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume c67599d1-3102-4cb1-84f0-308f6270e8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c67599d1-3102-4cb1-84f0-308f6270e8d8', 'volume_size': 1} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:46 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c Jul 16 12:52:46 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:46 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c" returned: 0 in 0.524s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:46 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c Jul 16 12:52:46 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:46 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c" returned: 0 in 0.330s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.362s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2138513333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c67599d1-3102-4cb1-84f0-308f6270e8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437ec441ff434f5c9a1e5806a21ef86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:52:46Z,use_quota=True,user_id='60e1b95ceb22406eac15af895cbc632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Creating volume c67599d1-3102-4cb1-84f0-308f6270e8d8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:52:46 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:46 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 1073741824 Jul 16 12:52:46 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:46 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-03caa93c-de34-41f3-b4dd-522b9675749c" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-03caa93c-de34-41f3-b4dd-522b9675749c" released by "delete_volume" :: held 0.908s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529665d-8717-4d25-8692-f3ac66c75ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf0c50e-f984-4710-b222-9cf662e6587c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d1513-19f9-4406-af99-ffda05b8914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume volume-3bf0c50e-f984-4710-b222-9cf662e6587c (3bf0c50e-f984-4710-b222-9cf662e6587c): created successfully Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8d1513-19f9-4406-af99-ffda05b8914b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Flow 'volume_create_manager' (5de860f5-c45e-43d0-918e-f6c56f91b269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-87108dd7-3818-4014-b195-fb09c6541551 tempest-TestServerVolumeAttachmentScenario-879109974 None] Created volume successfully. Jul 16 12:52:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Created reservations ['d9e3788f-96de-46a0-98ca-b7b357ad86ad', '119d34a2-1d85-4bb6-976a-9501c4c11100', '01acc3c2-dd16-4327-b64d-604e3e06d944', 'e557d94c-f8d6-4565-8617-0877b31f58a6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:47 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:47 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-1042169f-7b06-486b-986c-523a8920840a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "cinder-1042169f-7b06-486b-986c-523a8920840a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-quobyte-1042169f-7b06-486b-986c-523a8920840a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-1042169f-7b06-486b-986c-523a8920840a" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[77405da0-6d00-4d95-9a28-db288035f052]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:47 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 1073741824" returned: 0 in 0.719s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:47 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a Jul 16 12:52:47 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:47 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Deleted volume successfully. Jul 16 12:52:47 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 Jul 16 12:52:47 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4e06cdbe-8878-4846-b3b1-fcf1f7b8a9e9 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-03caa93c-de34-41f3-b4dd-522b9675749c-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:47 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d5a64c-4cfc-456f-b5c8-247cbf7a57e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c67599d1-3102-4cb1-84f0-308f6270e8d8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e082f3-338e-40e7-bcd6-caa51d3cfa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:52:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Volume volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 (c67599d1-3102-4cb1-84f0-308f6270e8d8): created successfully Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e082f3-338e-40e7-bcd6-caa51d3cfa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Flow 'volume_create_manager' (927e6bf5-7c1a-4d26-ba5a-2ad47fecd7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:52:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-47c67070-8555-45e0-9379-c190831441e4 tempest-TestServerVolumeAttachmentScenario-879109974 None] Created volume successfully. Jul 16 12:52:48 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a" returned: 0 in 0.766s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:48 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a Jul 16 12:52:48 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:48 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1042169f-7b06-486b-986c-523a8920840a" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-1042169f-7b06-486b-986c-523a8920840a" released by "delete_volume" :: held 1.189s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Created reservations ['40cff580-a72c-4c9f-a804-64148bbbd300', '0e9a5760-b93e-43d3-bdbb-38ab8db9a93f', 'a469cccd-3ac1-47cc-b4f2-6ec245bda791', '96caaddf-a734-45f4-be72-2a55333c428f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:48 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:48 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:48 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Deleted volume successfully. Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-94ddbc08-f37c-49d6-9798-db65aca5cd5d tempest-VolumesTestJSON-1165777402 None] Lock "cinder-1042169f-7b06-486b-986c-523a8920840a-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-e510ba2e-ae8a-46cf-838b-8b887283b6f9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-e510ba2e-ae8a-46cf-838b-8b887283b6f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "cinder-quobyte-e510ba2e-ae8a-46cf-838b-8b887283b6f9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-e510ba2e-ae8a-46cf-838b-8b887283b6f9" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2144c-b230-4367-a0bd-5a8e0c0038e4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:52:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:49 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 Jul 16 12:52:49 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:50 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:50 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9 Jul 16 12:52:50 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:50 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e510ba2e-ae8a-46cf-838b-8b887283b6f9" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-quobyte-e510ba2e-ae8a-46cf-838b-8b887283b6f9" released by "delete_volume" :: held 0.797s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Created reservations ['7eecaf76-61a1-485c-8520-8d43c291a80f', '9899af47-54a4-4420-9186-11e8ac211ee5', '34b63035-5746-4d0b-b1d4-6459430a1743', '24f612cf-c15d-4ef5-a7ab-f071d41334a8'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:52:50 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:52:50 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:52:50 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:52:50 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:52:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Deleted volume successfully. Jul 16 12:52:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f444cbd9-f41e-4e17-8026-6ea7fbc058a7 tempest-VolumesTestJSON-1165777402 None] Lock "cinder-e510ba2e-ae8a-46cf-838b-8b887283b6f9-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:52:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-84350151-f9b3-4724-8f35-dea4786770b1 req-18f8bb3c-9991-4747-b55a-ba185b168a70 tempest-AttachVolumeShelveTestJSON-2025376655 None] No connector for attachment 7cc1bd63-1ad2-4826-bfbd-b0fec4e2ab8e; skipping storage backend terminate_connection call. {{(pid=87560) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 16 12:52:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-84350151-f9b3-4724-8f35-dea4786770b1 req-18f8bb3c-9991-4747-b55a-ba185b168a70 tempest-AttachVolumeShelveTestJSON-2025376655 None] Deleting attachment 7cc1bd63-1ad2-4826-bfbd-b0fec4e2ab8e. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:52:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ef6220e-faa8-4ba9-8324-9a2540b53e5f tempest-BackendsCapabilitiesAdminTestsJSON-898777891 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 12:52:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63a6d8ed-1019-4d8f-bc77-e8771d904b39 tempest-BackendsCapabilitiesAdminTestsJSON-898777891 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 12:53:01 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=28,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:53:01 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=76,cinder:SELECT=41,cinder:INSERT=17,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:53:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7051b6b2-47bf-43ff-8d89-6c6be304c3fe tempest-GroupsV314Test-433536983 None] Group tempest-GroupsV314Test-Group-486206097: creating Jul 16 12:53:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7051b6b2-47bf-43ff-8d89-6c6be304c3fe tempest-GroupsV314Test-433536983 None] Group tempest-GroupsV314Test-Group-486206097: created successfully Jul 16 12:53:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7051b6b2-47bf-43ff-8d89-6c6be304c3fe tempest-GroupsV314Test-433536983 None] Create group completed successfully. Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:08 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:08 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:09 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:53:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:53:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:53:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Flow 'volume_create_manager' (8f4428ba-d09d-41de-81e0-ca11de697394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d5ce60-ff8d-431c-84c4-b011226a9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d5ce60-ff8d-431c-84c4-b011226a9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1964097570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c5aa5cf-3cc8-4e5d-afc7-37ec1e35d7cc,host='devstack@QuobyteHD#QuobyteHD',id=31021c73-4d01-4b26-81c0-7e0e40827ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7070d3a73e7d428fae9c83349bb43751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:53:11Z,use_quota=True,user_id='69972cfc7041466fa744d4c7f3c05999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81471be2-8f22-4a4a-b06f-4f130b3fb0ee),volume_type_id=81471be2-8f22-4a4a-b06f-4f130b3fb0ee)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201b375f-c43b-4f1d-87d1-116adb055c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201b375f-c43b-4f1d-87d1-116adb055c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d0697b-f662-4798-9d2e-fe1d9ecf0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d0697b-f662-4798-9d2e-fe1d9ecf0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31021c73-4d01-4b26-81c0-7e0e40827ffb', 'volume_name': 'volume-31021c73-4d01-4b26-81c0-7e0e40827ffb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805c8b93-2a63-4f39-9a99-9c40c23c1e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805c8b93-2a63-4f39-9a99-9c40c23c1e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29561702-9f29-4bc7-9acf-56e063028cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Volume 31021c73-4d01-4b26-81c0-7e0e40827ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31021c73-4d01-4b26-81c0-7e0e40827ffb', 'volume_size': 1} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6c5aa5cf-3cc8-4e5d-afc7-37ec1e35d7cc,created_at=2026-07-16T10:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1964097570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6c5aa5cf-3cc8-4e5d-afc7-37ec1e35d7cc,host='devstack@QuobyteHD#QuobyteHD',id=31021c73-4d01-4b26-81c0-7e0e40827ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7070d3a73e7d428fae9c83349bb43751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:53:11Z,use_quota=True,user_id='69972cfc7041466fa744d4c7f3c05999',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81471be2-8f22-4a4a-b06f-4f130b3fb0ee),volume_type_id=81471be2-8f22-4a4a-b06f-4f130b3fb0ee)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Creating volume 31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:53:10 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:53:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:11 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb 1073741824 Jul 16 12:53:11 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:11 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb 1073741824" returned: 0 in 0.676s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:11 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:11 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:12 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.659s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29561702-9f29-4bc7-9acf-56e063028cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31021c73-4d01-4b26-81c0-7e0e40827ffb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c78be-fe90-49c9-84da-782e84ead359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Volume volume-31021c73-4d01-4b26-81c0-7e0e40827ffb (31021c73-4d01-4b26-81c0-7e0e40827ffb): created successfully Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8c78be-fe90-49c9-84da-782e84ead359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Flow 'volume_create_manager' (8f4428ba-d09d-41de-81e0-ca11de697394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:53:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f637e42a-0bc8-40b9-a9e3-25edf802267c tempest-GroupsV314Test-433536983 None] Created volume successfully. Jul 16 12:53:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Cloning volume 31021c73-4d01-4b26-81c0-7e0e40827ffb to volume 2be0ffb4-6ffd-4b69-98f4-def9b760ff3f Jul 16 12:53:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Creating offline snapshot 91b424ea-c513-441b-bb0a-ed85341754dc of volume 31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:53:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b24e4e5-7542-47ab-b8e4-eb5bcaf85dca]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:16 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:16 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:17 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 1.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:17 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc 1G Jul 16 12:53:17 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:18 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc 1G" returned: 0 in 0.955s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31021c73-4d01-4b26-81c0-7e0e40827ffb -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:18 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31021c73-4d01-4b26-81c0-7e0e40827ffb -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:18 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:19 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31021c73-4d01-4b26-81c0-7e0e40827ffb -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.741s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:19 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:19 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:19 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:19 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:19 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info Jul 16 12:53:19 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:19 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:19 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:53:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:19 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info Jul 16 12:53:19 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:20 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.info" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Acquiring lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] snapshot: 91b424ea-c513-441b-bb0a-ed85341754dc, volume: 2be0ffb4-6ffd-4b69-98f4-def9b760ff3f, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2128fef6-a6b1-4f80-ab8b-d14036004e86]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:20 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:20 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:21 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.842s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31021c73-4d01-4b26-81c0-7e0e40827ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc172a5-f281-4505-bc54-26f8714ee503]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:21 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:21 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:21 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:53:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:21 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f Jul 16 12:53:21 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:29 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:53:29 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:53:31 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" returned: 0 in 9.601s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c75da-1870-48a9-84e7-042725740ad4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:31 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:31 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-20272dab-b898-48eb-9aa9-12eedd7a2b17 req-3365e3e0-a361-4937-80f4-f053be9b44d1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:32 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.937s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb, size 1024.00 MB, duration 9.60 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:53:32 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Converted 1024.00 MB image at 106.65 MB/s Jul 16 12:53:32 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:32 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f Jul 16 12:53:32 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:32 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" returned: 0 in 0.561s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" released by "_copy_volume_from_snapshot" :: held 12.560s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Acquiring lock "cinder-quobyte-91b424ea-c513-441b-bb0a-ed85341754dc" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-91b424ea-c513-441b-bb0a-ed85341754dc" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Deleting offline snapshot 91b424ea-c513-441b-bb0a-ed85341754dc of volume 31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] snapshot_file for this snap is: volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07a7d91-0ac6-4309-a705-745671955e61]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:33 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:33 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:33 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.660s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31021c73-4d01-4b26-81c0-7e0e40827ffb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:53:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5270eea3-83a4-4047-a00a-e82e7397ec87]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:33 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:33 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:34 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.778s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:34 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:34 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:53:35 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Flow 'volume_create_manager' (4b262397-0039-473c-87ef-3c7a837b0f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fd9cdd-b70f-4fcb-859d-4825acebc1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.700s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fd9cdd-b70f-4fcb-859d-4825acebc1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2131923409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f560b0c6-b4be-432e-853d-9dd520db06d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60069c6853a34cf28283029d5f782d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:53:35Z,use_quota=True,user_id='e6c3154e73e34698b568a814eee130c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:35 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc Jul 16 12:53:35 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd8294f-8e1e-41bf-a085-ccf990341e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd8294f-8e1e-41bf-a085-ccf990341e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a125a1c6-73b6-4a74-8a72-c64154ae1c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a125a1c6-73b6-4a74-8a72-c64154ae1c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f560b0c6-b4be-432e-853d-9dd520db06d3', 'volume_name': 'volume-f560b0c6-b4be-432e-853d-9dd520db06d3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfea250-9a8f-42d1-b3bf-7db5dc7f81e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfea250-9a8f-42d1-b3bf-7db5dc7f81e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffdbe44-0ecc-4997-80ea-08a8c86a804a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Volume f560b0c6-b4be-432e-853d-9dd520db06d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f560b0c6-b4be-432e-853d-9dd520db06d3', 'volume_size': 1} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:35 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb.91b424ea-c513-441b-bb0a-ed85341754dc" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-91b424ea-c513-441b-bb0a-ed85341754dc" released by "_delete_snapshot" :: held 2.555s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.917s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-20272dab-b898-48eb-9aa9-12eedd7a2b17 req-3365e3e0-a361-4937-80f4-f053be9b44d1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.282s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-20272dab-b898-48eb-9aa9-12eedd7a2b17 req-3365e3e0-a361-4937-80f4-f053be9b44d1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2131923409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f560b0c6-b4be-432e-853d-9dd520db06d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60069c6853a34cf28283029d5f782d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:53:35Z,use_quota=True,user_id='e6c3154e73e34698b568a814eee130c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Creating volume f560b0c6-b4be-432e-853d-9dd520db06d3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:53:35 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:35 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 1073741824 Jul 16 12:53:35 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-20272dab-b898-48eb-9aa9-12eedd7a2b17 req-3365e3e0-a361-4937-80f4-f053be9b44d1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-3bf0c50e-f984-4710-b222-9cf662e6587c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec8f4797-57c9-485d-9752-e2d1d9c0e52d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:53:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-90a6ad9f-c465-4d40-93de-2a4ffe4fc3ad tempest-GroupsV314Test-433536983 None] Create group from source-group-6c5aa5cf-3cc8-4e5d-afc7-37ec1e35d7cc completed successfully. Jul 16 12:53:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-20272dab-b898-48eb-9aa9-12eedd7a2b17 req-3365e3e0-a361-4937-80f4-f053be9b44d1 tempest-TestServerVolumeAttachmentScenario-879109974 None] attachment_update completed successfully. Jul 16 12:53:36 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 1073741824" returned: 0 in 0.880s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:36 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 Jul 16 12:53:36 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:37 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3" returned: 0 in 0.628s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffdbe44-0ecc-4997-80ea-08a8c86a804a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f560b0c6-b4be-432e-853d-9dd520db06d3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496d5fd3-1cb7-4371-b680-90ed4fbfb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:53:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Volume volume-f560b0c6-b4be-432e-853d-9dd520db06d3 (f560b0c6-b4be-432e-853d-9dd520db06d3): created successfully Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (496d5fd3-1cb7-4371-b680-90ed4fbfb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Flow 'volume_create_manager' (4b262397-0039-473c-87ef-3c7a837b0f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Acquiring lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b2e535f6-290a-42a0-aef9-1cc7ce50ea79 tempest-ServerRescueNegativeTestJSON-1966361535 None] Created volume successfully. Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e992d45-479e-4cd4-ad80-254afd6d6ad4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:37 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f Jul 16 12:53:37 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:37 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" returned: 0 in 0.507s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:37 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f Jul 16 12:53:37 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:38 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" returned: 0 in 0.330s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-2be0ffb4-6ffd-4b69-98f4-def9b760ff3f" released by "delete_volume" :: held 0.927s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Created reservations ['dc24496c-f6f5-4b9b-ad58-20768a88aea0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:38 devstack cinder-volume[87560]: WARNING cinder.quota [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-753436991 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-753436991, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:53:38 devstack cinder-volume[87560]: WARNING cinder.quota [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-753436991 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-753436991, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Created reservations ['8542a9c6-6e22-486a-8b7c-08398a2db23e', '0feea780-91e8-4b98-a727-ae56c7398026', '7ba0fab8-9bcb-4926-a720-f69b9515f8d2', 'b1c6b7a6-70a3-42dd-b904-645c674fd875'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:38 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:38 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:39 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:53:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1e1d9e73-2e67-461c-a57f-009e3c7fa784 tempest-GroupsV314Test-433536983 None] Delete group completed successfully. Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Acquiring lock "cinder-quobyte-31021c73-4d01-4b26-81c0-7e0e40827ffb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-31021c73-4d01-4b26-81c0-7e0e40827ffb" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b166e1fc-8e2e-49ba-8f77-fc792d5a5a06]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:39 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:39 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:39 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:39 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb Jul 16 12:53:39 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:40 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-31021c73-4d01-4b26-81c0-7e0e40827ffb" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Lock "cinder-quobyte-31021c73-4d01-4b26-81c0-7e0e40827ffb" released by "delete_volume" :: held 0.948s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Created reservations ['4d2f265b-ea5c-4b3f-a573-11100a2c55fc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Created reservations ['530ed0c3-4bad-42b0-839d-b112177d32e4', 'fab870a8-5637-431d-b2be-4a0a6c596a9b', '842bb579-df81-40cb-bd51-30f018416229', 'da065b0a-ee74-4630-b750-896f45eee7e2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:40 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:40 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:41 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.480s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:53:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-255ec9f5-9b81-4415-b889-b81e8859de79 tempest-GroupsV314Test-433536983 None] Delete group completed successfully. Jul 16 12:53:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-21e7cdb7-3cbc-47bf-8a2c-298230b99d8a req-cbccdfec-67b9-4a52-9748-bf4ef32b37a2 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-21e7cdb7-3cbc-47bf-8a2c-298230b99d8a req-cbccdfec-67b9-4a52-9748-bf4ef32b37a2 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-21e7cdb7-3cbc-47bf-8a2c-298230b99d8a req-cbccdfec-67b9-4a52-9748-bf4ef32b37a2 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-21e7cdb7-3cbc-47bf-8a2c-298230b99d8a req-cbccdfec-67b9-4a52-9748-bf4ef32b37a2 tempest-TestServerVolumeAttachmentScenario-879109974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-c67599d1-3102-4cb1-84f0-308f6270e8d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2078396a-cf66-4e9f-9890-7796748d51a9', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:53:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-21e7cdb7-3cbc-47bf-8a2c-298230b99d8a req-cbccdfec-67b9-4a52-9748-bf4ef32b37a2 tempest-TestServerVolumeAttachmentScenario-879109974 None] attachment_update completed successfully. Jul 16 12:53:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-4cb89892-e8b2-42de-844b-55b64cceb300 req-f8362907-9cbe-4ea1-aeda-6d77d19b44bf tempest-TestServerVolumeAttachmentScenario-879109974 None] Terminate volume connection completed successfully. Jul 16 12:53:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-4cb89892-e8b2-42de-844b-55b64cceb300 req-f8362907-9cbe-4ea1-aeda-6d77d19b44bf tempest-TestServerVolumeAttachmentScenario-879109974 None] Deleting attachment 2078396a-cf66-4e9f-9890-7796748d51a9. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:53:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-88048da1-8fd0-42cd-9813-3f29ec31313a req-6544f54b-6070-4c2b-afbd-40067a5f3383 tempest-TestServerVolumeAttachmentScenario-879109974 None] Terminate volume connection completed successfully. Jul 16 12:53:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-88048da1-8fd0-42cd-9813-3f29ec31313a req-6544f54b-6070-4c2b-afbd-40067a5f3383 tempest-TestServerVolumeAttachmentScenario-879109974 None] Deleting attachment ec8f4797-57c9-485d-9752-e2d1d9c0e52d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:53:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Acquiring lock "cinder-f560b0c6-b4be-432e-853d-9dd520db06d3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "cinder-f560b0c6-b4be-432e-853d-9dd520db06d3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Acquiring lock "cinder-quobyte-f560b0c6-b4be-432e-853d-9dd520db06d3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "cinder-quobyte-f560b0c6-b4be-432e-853d-9dd520db06d3" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d27920d-47f4-44c5-9060-6c135828114e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:50 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 Jul 16 12:53:50 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:50 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3" returned: 0 in 0.759s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:50 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3 Jul 16 12:53:50 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:51 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f560b0c6-b4be-432e-853d-9dd520db06d3" returned: 0 in 0.484s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "cinder-quobyte-f560b0c6-b4be-432e-853d-9dd520db06d3" released by "delete_volume" :: held 1.325s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Created reservations ['93412524-2e60-401e-89de-6f192be7988b', '349b425e-d63e-4d96-990a-d7e4d6b461dc', 'c1c2dd21-e1da-405f-adaf-1df1c7e21b98', '3e81e4f0-d340-43fa-aaf9-f635619e7bef'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:51 devstack sudo[94426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:51 devstack sudo[94426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:52 devstack sudo[94426]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:52 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:53:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Deleted volume successfully. Jul 16 12:53:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b2fb6dc7-f6b0-4525-8044-b97ada0ac617 tempest-ServerRescueNegativeTestJSON-1966361535 None] Lock "cinder-f560b0c6-b4be-432e-853d-9dd520db06d3-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "cinder-c67599d1-3102-4cb1-84f0-308f6270e8d8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-c67599d1-3102-4cb1-84f0-308f6270e8d8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "cinder-quobyte-c67599d1-3102-4cb1-84f0-308f6270e8d8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-quobyte-c67599d1-3102-4cb1-84f0-308f6270e8d8" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b9c45c-5d64-4c39-a880-79d284aecd6c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:56 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 Jul 16 12:53:56 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:56 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8" returned: 0 in 0.497s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:56 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8 Jul 16 12:53:56 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:57 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c67599d1-3102-4cb1-84f0-308f6270e8d8" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-quobyte-c67599d1-3102-4cb1-84f0-308f6270e8d8" released by "delete_volume" :: held 0.904s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Created reservations ['c0511189-fdb4-4048-b659-04998cc2af55', 'e7a3687f-3aa0-42a7-8bcc-b5e846dc6499', 'c30fd113-9015-4587-aefe-93bf1d89f707', '03aec9af-de70-4273-ab9c-b9b1f971b096'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:57 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:57 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:57 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:53:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Deleted volume successfully. Jul 16 12:53:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6df971b4-e12d-4ae9-b699-7ee864f9e798 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-c67599d1-3102-4cb1-84f0-308f6270e8d8-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "cinder-3bf0c50e-f984-4710-b222-9cf662e6587c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-3bf0c50e-f984-4710-b222-9cf662e6587c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "cinder-quobyte-3bf0c50e-f984-4710-b222-9cf662e6587c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-quobyte-3bf0c50e-f984-4710-b222-9cf662e6587c" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[405a7f27-acf5-4674-82c1-ed780ee79af2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:53:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:58 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c Jul 16 12:53:58 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:59 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c" returned: 0 in 0.539s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:59 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c Jul 16 12:53:59 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:53:59 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3bf0c50e-f984-4710-b222-9cf662e6587c" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-quobyte-3bf0c50e-f984-4710-b222-9cf662e6587c" released by "delete_volume" :: held 0.945s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Created reservations ['d4c9a593-425e-4fab-99de-04c3c9378350', '534dfe59-2544-48ae-8605-7c94380436df', '175e6f59-217a-43ec-94c3-1101c2db213a', '74a5cb4a-3e49-4e42-a8de-21a2ec67c3e4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:53:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:53:59 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:53:59 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:00 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Deleted volume successfully. Jul 16 12:54:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-934102a0-d5dc-4399-99cd-e8656e5106b1 tempest-TestServerVolumeAttachmentScenario-879109974 None] Lock "cinder-3bf0c50e-f984-4710-b222-9cf662e6587c-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Flow 'volume_create_manager' (f6b0c749-4aab-4b08-989f-13b1c1b2043d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb643f00-46a5-42c6-85e8-7d956544962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb643f00-46a5-42c6-85e8-7d956544962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011120135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771ba34a-8715-4bac-bdb6-c915abd95380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b40575b14fe494f873760474f4194e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:02Z,use_quota=True,user_id='a472d5146aa0461abea60b4d356788ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2d4877-b4ac-4f33-b1cc-6084965aa696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef2d4877-b4ac-4f33-b1cc-6084965aa696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf225d2-9096-412a-8782-e5d321c02201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf225d2-9096-412a-8782-e5d321c02201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771ba34a-8715-4bac-bdb6-c915abd95380', 'volume_name': 'volume-771ba34a-8715-4bac-bdb6-c915abd95380', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e3e0e5-6bcd-4447-a890-0164d4ca6658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e3e0e5-6bcd-4447-a890-0164d4ca6658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f7ef57-fe4b-4b0b-9b4d-2c0345639c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume 771ba34a-8715-4bac-bdb6-c915abd95380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771ba34a-8715-4bac-bdb6-c915abd95380', 'volume_size': 1} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011120135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771ba34a-8715-4bac-bdb6-c915abd95380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b40575b14fe494f873760474f4194e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:02Z,use_quota=True,user_id='a472d5146aa0461abea60b4d356788ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Creating volume 771ba34a-8715-4bac-bdb6-c915abd95380 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:54:01 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:54:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:01 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 1073741824 Jul 16 12:54:01 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:02 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 1073741824" returned: 0 in 0.571s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:02 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 Jul 16 12:54:02 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:02 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380" returned: 0 in 0.345s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f7ef57-fe4b-4b0b-9b4d-2c0345639c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771ba34a-8715-4bac-bdb6-c915abd95380', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73287695-0904-4182-b668-f9887ef22e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume volume-771ba34a-8715-4bac-bdb6-c915abd95380 (771ba34a-8715-4bac-bdb6-c915abd95380): created successfully Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73287695-0904-4182-b668-f9887ef22e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Flow 'volume_create_manager' (f6b0c749-4aab-4b08-989f-13b1c1b2043d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-98a106a6-7484-4453-80f2-03c148d214cc tempest-VolumeQuotasAdminTestJSON-978557303 None] Created volume successfully. Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Acquiring lock "cinder-eedd5910-1cb9-406e-b074-b006d14943ca-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "cinder-eedd5910-1cb9-406e-b074-b006d14943ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Acquiring lock "cinder-quobyte-eedd5910-1cb9-406e-b074-b006d14943ca" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "cinder-quobyte-eedd5910-1cb9-406e-b074-b006d14943ca" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1de7d-49e5-49b6-b85b-7dda8b63d46a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:03 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca Jul 16 12:54:03 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "cinder-771ba34a-8715-4bac-bdb6-c915abd95380-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "cinder-771ba34a-8715-4bac-bdb6-c915abd95380-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "cinder-quobyte-771ba34a-8715-4bac-bdb6-c915abd95380" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "cinder-quobyte-771ba34a-8715-4bac-bdb6-c915abd95380" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad36f21-9b8a-477f-b9c7-817ee9213aa4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:04 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca" returned: 0 in 0.642s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:04 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca Jul 16 12:54:04 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:04 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 Jul 16 12:54:04 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:04 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-eedd5910-1cb9-406e-b074-b006d14943ca" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "cinder-quobyte-eedd5910-1cb9-406e-b074-b006d14943ca" released by "delete_volume" :: held 1.022s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Created reservations ['8adeb8a7-4e2b-471b-b3d7-bc96965bf8e2', '78309fdb-f56d-4eef-894f-ae064d8d7bc3', '0d8042f6-f839-43bf-a998-db4bbdf19945', '4bf019c4-696a-4d70-a4f2-478ff9fafd05'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:54:04 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380" returned: 0 in 0.553s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:04 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380 Jul 16 12:54:04 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:04 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:04 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:04 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-771ba34a-8715-4bac-bdb6-c915abd95380" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "cinder-quobyte-771ba34a-8715-4bac-bdb6-c915abd95380" released by "delete_volume" :: held 0.999s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:05 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Deleted volume successfully. Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Created reservations ['815519de-00c2-4ea3-9c09-b74a3f996d2e', 'e53842aa-6052-4b7a-86b2-e69003959958', '54d24d3c-5cc9-44fd-a845-43b6b7cf7b3d', 'aa37c91a-8fcd-4b56-aff0-5af37e08fae3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85fa09fc-d8ea-4f96-8cc7-2d87fd08473d tempest-AttachVolumeShelveTestJSON-2025376655 None] Lock "cinder-eedd5910-1cb9-406e-b074-b006d14943ca-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:05 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:05 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:05 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Deleted volume successfully. Jul 16 12:54:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b65cb19-66e7-4e60-9635-59ebea7527f6 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "cinder-771ba34a-8715-4bac-bdb6-c915abd95380-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Flow 'volume_create_manager' (92b26847-5e31-4840-9884-f99bf789749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6664df-b82e-4cee-932b-b4f7e01e5c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6664df-b82e-4cee-932b-b4f7e01e5c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1452995938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359a96a3-ad10-4fd1-a7ea-e440aa21f7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b40575b14fe494f873760474f4194e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:07Z,use_quota=True,user_id='a472d5146aa0461abea60b4d356788ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68829dd5-42b2-4f64-9f22-ed562483738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68829dd5-42b2-4f64-9f22-ed562483738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d763300-eb25-49ff-8a04-0fa178c94a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d763300-eb25-49ff-8a04-0fa178c94a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359a96a3-ad10-4fd1-a7ea-e440aa21f7b0', 'volume_name': 'volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7418717-b491-4095-ba24-28482679a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7418717-b491-4095-ba24-28482679a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecb4641-0ff9-45a6-8051-03277109d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume 359a96a3-ad10-4fd1-a7ea-e440aa21f7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0', 'volume_size': 1} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1452995938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359a96a3-ad10-4fd1-a7ea-e440aa21f7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b40575b14fe494f873760474f4194e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:07Z,use_quota=True,user_id='a472d5146aa0461abea60b4d356788ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Creating volume 359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:54:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:54:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:06 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 1073741824 Jul 16 12:54:06 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:07 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 1073741824" returned: 0 in 0.519s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:07 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 Jul 16 12:54:07 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:07 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecb4641-0ff9-45a6-8051-03277109d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17cd471-b34a-4eed-b089-6787bdd59e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Volume volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 (359a96a3-ad10-4fd1-a7ea-e440aa21f7b0): created successfully Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f17cd471-b34a-4eed-b089-6787bdd59e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Flow 'volume_create_manager' (92b26847-5e31-4840-9884-f99bf789749d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d237d4bf-c893-4924-9251-0eca437f3a76 tempest-VolumeQuotasAdminTestJSON-978557303 None] Created volume successfully. Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:08 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:08 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:09 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:54:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:54:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:54:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-29e1a290-f217-456a-80ed-236a80be79fb tempest-VolumeQuotasAdminTestJSON-2045088189 None] Transfer volume completed successfully. Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Acquiring lock "cinder-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "cinder-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Acquiring lock "cinder-quobyte-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "cinder-quobyte-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9f895f-56af-4d1f-b4f2-07f255c31a96]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:54:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:10 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 Jul 16 12:54:10 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:11 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:11 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0 Jul 16 12:54:11 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:11 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "cinder-quobyte-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0" released by "delete_volume" :: held 0.833s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Created reservations ['227f183f-1575-483f-9141-3a904d19da54', 'b378236c-96fb-4270-aa6a-48d425e36cf9', '962db2f1-15fb-4ca0-a520-17e744704a4f', 'd695997f-30c5-4955-ac47-3ecd382fec7a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:11 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:11 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:12 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:12 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Deleted volume successfully. Jul 16 12:54:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61995878-fd72-4f8a-a518-2a040d57b064 tempest-VolumeQuotasAdminTestJSON-783883078 None] Lock "cinder-359a96a3-ad10-4fd1-a7ea-e440aa21f7b0-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:21 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=71,cinder:UPDATE=84,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:54:22 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=69,cinder:UPDATE=86,cinder:DELETE=6,cinder:INSERT=17 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Flow 'volume_create_manager' (02bb6755-b21a-498e-b549-fba44c957790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c718ea-779e-4f84-9c3c-66f8698bd47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c718ea-779e-4f84-9c3c-66f8698bd47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-203696051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb18a7b-e090-473b-9a28-8747bff86780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7f940ef1a5421189accac7c43fc3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:30Z,use_quota=True,user_id='b907455fa211462b9f7c49cf1c58544d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0737967c-8c11-405c-aa81-f518f42b88e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0737967c-8c11-405c-aa81-f518f42b88e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010e152b-1cd8-419f-873a-d4b1753892d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (010e152b-1cd8-419f-873a-d4b1753892d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb18a7b-e090-473b-9a28-8747bff86780', 'volume_name': 'volume-9fb18a7b-e090-473b-9a28-8747bff86780', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b853704-40aa-4abf-ad36-1d6d5bb6f07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b853704-40aa-4abf-ad36-1d6d5bb6f07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcbdc53-4149-43cf-8df5-7fc9105032df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Volume 9fb18a7b-e090-473b-9a28-8747bff86780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb18a7b-e090-473b-9a28-8747bff86780', 'volume_size': 1} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-203696051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb18a7b-e090-473b-9a28-8747bff86780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7f940ef1a5421189accac7c43fc3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:30Z,use_quota=True,user_id='b907455fa211462b9f7c49cf1c58544d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Creating volume 9fb18a7b-e090-473b-9a28-8747bff86780 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:54:30 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:54:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:30 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 1073741824 Jul 16 12:54:30 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:31 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 1073741824" returned: 0 in 0.646s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:31 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 Jul 16 12:54:31 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:31 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780" returned: 0 in 0.330s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcbdc53-4149-43cf-8df5-7fc9105032df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb18a7b-e090-473b-9a28-8747bff86780', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb5c59-dbd5-4cf6-add5-855d9f14cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Volume volume-9fb18a7b-e090-473b-9a28-8747bff86780 (9fb18a7b-e090-473b-9a28-8747bff86780): created successfully Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fb5c59-dbd5-4cf6-add5-855d9f14cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Flow 'volume_create_manager' (02bb6755-b21a-498e-b549-fba44c957790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-631e0471-71b0-493f-a0d8-ad60c85bfac9 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Created volume successfully. Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Acquiring lock "cinder-9fb18a7b-e090-473b-9a28-8747bff86780-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "cinder-9fb18a7b-e090-473b-9a28-8747bff86780-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Acquiring lock "cinder-quobyte-9fb18a7b-e090-473b-9a28-8747bff86780" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "cinder-quobyte-9fb18a7b-e090-473b-9a28-8747bff86780" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee9beb-fead-4a79-93ba-e90e04a66897]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:54:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:34 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 Jul 16 12:54:34 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:34 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:34 devstack sudo[94640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780 Jul 16 12:54:34 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:34 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9fb18a7b-e090-473b-9a28-8747bff86780" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "cinder-quobyte-9fb18a7b-e090-473b-9a28-8747bff86780" released by "delete_volume" :: held 1.019s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Created reservations ['98b5c5c8-e848-4e14-ba22-2d1348f974e2', 'c6f1095f-37e0-4fae-b46c-8f5a4ace3e62', 'd6be5006-53c2-4d94-964a-dfbf3a30aca6', '94f47abb-c766-477c-a6a3-d639f9eb4df1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:35 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:35 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:35 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.434s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Deleted volume successfully. Jul 16 12:54:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2ce0add-d869-4ffa-b585-c868783b0748 tempest-VolumeQuotasNegativeTestJSON-1902293529 None] Lock "cinder-9fb18a7b-e090-473b-9a28-8747bff86780-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:45 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:54:45 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=12,cinder:SELECT=7,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Flow 'volume_create_manager' (24dc2a2a-478a-49e7-bd3a-309ed628af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3e237f-bd89-4b25-881c-31cff8b148a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3e237f-bd89-4b25-881c-31cff8b148a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2128695278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dce2d72-7048-43f5-ae58-701ec0a21250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f1b6565fb54a3ead67f5feb9e215e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:51Z,use_quota=True,user_id='a77d7e3dcc5248a4b75248d26440d3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bd27bc-1eca-45d2-9d24-bb138d65fa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bd27bc-1eca-45d2-9d24-bb138d65fa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f172e4ad-3e8d-470c-8ab8-d4a11b12ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f172e4ad-3e8d-470c-8ab8-d4a11b12ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dce2d72-7048-43f5-ae58-701ec0a21250', 'volume_name': 'volume-9dce2d72-7048-43f5-ae58-701ec0a21250', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0fa955-9396-4f9c-b00f-5fcb585cd6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0fa955-9396-4f9c-b00f-5fcb585cd6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf9dfdb-277e-49b8-b058-9a79a80ead72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Volume 9dce2d72-7048-43f5-ae58-701ec0a21250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dce2d72-7048-43f5-ae58-701ec0a21250', 'volume_size': 1} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2128695278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dce2d72-7048-43f5-ae58-701ec0a21250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f1b6565fb54a3ead67f5feb9e215e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:51Z,use_quota=True,user_id='a77d7e3dcc5248a4b75248d26440d3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Creating volume 9dce2d72-7048-43f5-ae58-701ec0a21250 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:54:51 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:51 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 1073741824 Jul 16 12:54:51 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Flow 'volume_create_manager' (3a2bfaec-c40a-4df9-82e6-f87723e947fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1db0a-a79d-4688-89b7-8c66e9710e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1db0a-a79d-4688-89b7-8c66e9710e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1362472833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540af084-f7b4-43df-98c2-a5a19495a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cffec697b5a842b9bac88acc2bcc811d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:51Z,use_quota=True,user_id='af67af83dd08414f8abbc3148531befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d984047-331f-40c1-b651-e328ee79a643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d984047-331f-40c1-b651-e328ee79a643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70aba6ac-5be1-4603-989f-82fc2be6a672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70aba6ac-5be1-4603-989f-82fc2be6a672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540af084-f7b4-43df-98c2-a5a19495a720', 'volume_name': 'volume-540af084-f7b4-43df-98c2-a5a19495a720', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b4195-5e0b-46f7-889e-5cea1b9fb9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (017b4195-5e0b-46f7-889e-5cea1b9fb9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0441266b-7125-4d92-a1d9-17f8c7867b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Volume 540af084-f7b4-43df-98c2-a5a19495a720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540af084-f7b4-43df-98c2-a5a19495a720', 'volume_size': 1} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:51 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 1073741824" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:52 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 Jul 16 12:54:52 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:52 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1362472833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540af084-f7b4-43df-98c2-a5a19495a720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cffec697b5a842b9bac88acc2bcc811d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:54:51Z,use_quota=True,user_id='af67af83dd08414f8abbc3148531befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Creating volume 540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:54:52 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf9dfdb-277e-49b8-b058-9a79a80ead72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dce2d72-7048-43f5-ae58-701ec0a21250', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:52 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 1073741824 Jul 16 12:54:52 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13541c7-254e-4786-aea8-75cc359a9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Volume volume-9dce2d72-7048-43f5-ae58-701ec0a21250 (9dce2d72-7048-43f5-ae58-701ec0a21250): created successfully Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13541c7-254e-4786-aea8-75cc359a9524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Flow 'volume_create_manager' (24dc2a2a-478a-49e7-bd3a-309ed628af37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-50ce6c7f-2e8d-4f81-a0f2-c6a9483819e7 tempest-VolumesServicesTestJSON-1577369099 None] Created volume successfully. Jul 16 12:54:52 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 1073741824" returned: 0 in 0.527s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:52 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:54:52 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:53 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.319s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0441266b-7125-4d92-a1d9-17f8c7867b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540af084-f7b4-43df-98c2-a5a19495a720', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c94a15f-3cd6-45f1-81b2-fa673974f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:54:53 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Volume volume-540af084-f7b4-43df-98c2-a5a19495a720 (540af084-f7b4-43df-98c2-a5a19495a720): created successfully Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c94a15f-3cd6-45f1-81b2-fa673974f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Flow 'volume_create_manager' (3a2bfaec-c40a-4df9-82e6-f87723e947fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:54:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fb45ae31-10b6-41e1-95cd-adf970001f12 tempest-TestStampPattern-795511305 None] Created volume successfully. Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Acquiring lock "cinder-9dce2d72-7048-43f5-ae58-701ec0a21250-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "cinder-9dce2d72-7048-43f5-ae58-701ec0a21250-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Acquiring lock "cinder-quobyte-9dce2d72-7048-43f5-ae58-701ec0a21250" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "cinder-quobyte-9dce2d72-7048-43f5-ae58-701ec0a21250" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0fa9f-ec74-45ff-980b-0238c06c9431]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:53 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 Jul 16 12:54:53 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:53 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:53 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250 Jul 16 12:54:53 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:54 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9dce2d72-7048-43f5-ae58-701ec0a21250" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "cinder-quobyte-9dce2d72-7048-43f5-ae58-701ec0a21250" released by "delete_volume" :: held 1.017s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Created reservations ['07d03ae4-2c20-492c-94c5-c407d4830151', '3e23a77c-2cf6-49ec-9d9c-997a9b05bb03', '2f0fe7c0-9302-4e96-a825-448c738f2695', '7cdc0fe5-1a36-49b2-a1f6-df16bcad6d3d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:54:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:54:54 devstack sudo[94882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:54:54 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:54:55 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root Jul 16 12:54:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.655s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:54:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:54:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Deleted volume successfully. Jul 16 12:54:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c055942f-a006-4670-b23f-6f9d185f4cf4 tempest-VolumesServicesTestJSON-1577369099 None] Lock "cinder-9dce2d72-7048-43f5-ae58-701ec0a21250-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:04 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:55:05 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:08 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:55:08 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:09 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.461s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:55:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:55:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:55:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Flow 'volume_create_manager' (89ff888d-454a-4e95-8dca-51653d884680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d836e01-766b-4dc5-a59e-6a9b57a43c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d836e01-766b-4dc5-a59e-6a9b57a43c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-70785169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660bff06-fa5e-4251-b2cf-4cd50d2a0aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f275fbfecb240ed912fb6488ff2f122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:11Z,use_quota=True,user_id='61b182bdcb6243fbb5a9d9267761b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e00d01f-e1b6-405d-97cd-e38e93b7f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e00d01f-e1b6-405d-97cd-e38e93b7f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eeddc32-9f71-4749-b096-ee037f794aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eeddc32-9f71-4749-b096-ee037f794aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660bff06-fa5e-4251-b2cf-4cd50d2a0aaf', 'volume_name': 'volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8ebce-8241-4370-b42e-a845d62ca494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e8ebce-8241-4370-b42e-a845d62ca494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6265e56-274b-451d-a805-fc7424196498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Volume 660bff06-fa5e-4251-b2cf-4cd50d2a0aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf', 'volume_size': 1} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-70785169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660bff06-fa5e-4251-b2cf-4cd50d2a0aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f275fbfecb240ed912fb6488ff2f122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:11Z,use_quota=True,user_id='61b182bdcb6243fbb5a9d9267761b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Creating volume 660bff06-fa5e-4251-b2cf-4cd50d2a0aaf {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:55:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:11 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf 1073741824 Jul 16 12:55:11 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:12 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf 1073741824" returned: 0 in 0.848s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:12 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf Jul 16 12:55:12 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:12 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6265e56-274b-451d-a805-fc7424196498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae1d3ba-28dc-47d3-a5c7-bbfe16fd6090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Volume volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf (660bff06-fa5e-4251-b2cf-4cd50d2a0aaf): created successfully Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae1d3ba-28dc-47d3-a5c7-bbfe16fd6090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Flow 'volume_create_manager' (89ff888d-454a-4e95-8dca-51653d884680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1fa4f32b-e2ee-4418-bdb4-d9d048b635c6 tempest-ServersNegativeTestJSON-1689057512 None] Created volume successfully. Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Flow 'volume_create_manager' (200daed1-82a3-41e5-85af-20ba6b63ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd8ce1-5658-48e6-af5c-370fdf0ab53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd8ce1-5658-48e6-af5c-370fdf0ab53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1788724183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b3153b-2d87-4548-823b-732c88cc93a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f275fbfecb240ed912fb6488ff2f122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:15Z,use_quota=True,user_id='61b182bdcb6243fbb5a9d9267761b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f1a7f-49d0-405d-a1ac-5c5802287cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536f1a7f-49d0-405d-a1ac-5c5802287cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084626b-7d46-4ccc-b4c4-38c742e6f981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084626b-7d46-4ccc-b4c4-38c742e6f981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b3153b-2d87-4548-823b-732c88cc93a0', 'volume_name': 'volume-01b3153b-2d87-4548-823b-732c88cc93a0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d1163e-6043-47fe-9904-5780c3c0b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d1163e-6043-47fe-9904-5780c3c0b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50ee95-2ae2-4bd0-bff6-5453d1091ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Volume 01b3153b-2d87-4548-823b-732c88cc93a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b3153b-2d87-4548-823b-732c88cc93a0', 'volume_size': 1} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1788724183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b3153b-2d87-4548-823b-732c88cc93a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f275fbfecb240ed912fb6488ff2f122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:15Z,use_quota=True,user_id='61b182bdcb6243fbb5a9d9267761b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Creating volume 01b3153b-2d87-4548-823b-732c88cc93a0 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:15 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 1073741824 Jul 16 12:55:15 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:15 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 1073741824" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:15 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 Jul 16 12:55:15 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:16 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50ee95-2ae2-4bd0-bff6-5453d1091ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b3153b-2d87-4548-823b-732c88cc93a0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6568a482-6d8e-420a-8613-6bdcb885ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Volume volume-01b3153b-2d87-4548-823b-732c88cc93a0 (01b3153b-2d87-4548-823b-732c88cc93a0): created successfully Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6568a482-6d8e-420a-8613-6bdcb885ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Flow 'volume_create_manager' (200daed1-82a3-41e5-85af-20ba6b63ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ee47c18-aade-4434-af1a-a9ecd9b2691a tempest-ServersNegativeTestJSON-1689057512 None] Created volume successfully. Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "cinder-01b3153b-2d87-4548-823b-732c88cc93a0-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-01b3153b-2d87-4548-823b-732c88cc93a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "cinder-quobyte-01b3153b-2d87-4548-823b-732c88cc93a0" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-quobyte-01b3153b-2d87-4548-823b-732c88cc93a0" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[785bd8ed-92f4-42e6-8b29-3784f40e8444]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:18 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 Jul 16 12:55:18 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:18 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:18 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0 Jul 16 12:55:18 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:18 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-01b3153b-2d87-4548-823b-732c88cc93a0" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-quobyte-01b3153b-2d87-4548-823b-732c88cc93a0" released by "delete_volume" :: held 0.914s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Created reservations ['0def787b-fbe7-4be1-aca8-4c7c381a2ae3', 'f4b56d70-fde5-48ed-af86-36370fa91872', '7233056f-0664-4f2e-9eff-fdd426404f1e', 'fb93869f-0cbb-4174-9f3e-53d70b8e36a5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:19 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:55:19 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "cinder-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "cinder-quobyte-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-quobyte-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[933adfcc-975a-4ea0-b1e2-a687f14d4e46]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:19 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:55:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Deleted volume successfully. Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-53ec2695-74ef-45d3-82c8-8bbc4c3aabda tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-01b3153b-2d87-4548-823b-732c88cc93a0-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:19 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf Jul 16 12:55:19 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:19 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" returned: 0 in 0.525s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:20 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf Jul 16 12:55:20 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:20 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-quobyte-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf" released by "delete_volume" :: held 0.904s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Created reservations ['1ae5a4fd-60eb-4ec1-8dea-0d375de9d994', '5df6640b-57de-427c-a41e-4c2f2e9dd20c', 'b834a32f-5477-4641-8850-bb1b3d3334a5', '66939a76-e386-4366-9762-45859c9822ea'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:20 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:55:20 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:20 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:55:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Deleted volume successfully. Jul 16 12:55:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4c2a6211-c262-431f-a21e-b62863f01100 tempest-ServersNegativeTestJSON-1689057512 None] Lock "cinder-660bff06-fa5e-4251-b2cf-4cd50d2a0aaf-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (6e2db05f-c625-44f3-a40f-ebaf805b781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c29a70-e9c4-4169-a143-4d68bb306507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c29a70-e9c4-4169-a143-4d68bb306507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-100412827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06600d5e-6a22-4e55-93ac-c7d7c2e799e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:25Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258c8579-5e53-4884-aa59-85897cca2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258c8579-5e53-4884-aa59-85897cca2aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca33f367-170a-4639-a2b8-6d64eb9660ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca33f367-170a-4639-a2b8-6d64eb9660ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06600d5e-6a22-4e55-93ac-c7d7c2e799e1', 'volume_name': 'volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dba67c2-5986-4f27-9c06-5ea6dccbbda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dba67c2-5986-4f27-9c06-5ea6dccbbda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7125b-ce93-4180-a47e-4bb5a8c732fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Volume 06600d5e-6a22-4e55-93ac-c7d7c2e799e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1', 'volume_size': 1} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-100412827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06600d5e-6a22-4e55-93ac-c7d7c2e799e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:25Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Creating volume 06600d5e-6a22-4e55-93ac-c7d7c2e799e1 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:55:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:24 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 1073741824 Jul 16 12:55:24 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:25 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 1073741824" returned: 0 in 0.515s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:25 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 Jul 16 12:55:25 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:25 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a7125b-ce93-4180-a47e-4bb5a8c732fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023a118a-b451-4152-a98c-2676c4dd8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Volume volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 (06600d5e-6a22-4e55-93ac-c7d7c2e799e1): created successfully Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023a118a-b451-4152-a98c-2676c4dd8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (6e2db05f-c625-44f3-a40f-ebaf805b781a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c307ea65-fddf-4ed5-a160-70243eba8306 tempest-AttachVolumeNegativeTest-2043106783 None] Created volume successfully. Jul 16 12:55:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-47fe1958-76d1-473d-aaaa-0aed66f07f56 req-6a2af4cd-0491-4e55-a77f-c1141c3fb510 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-47fe1958-76d1-473d-aaaa-0aed66f07f56 req-6a2af4cd-0491-4e55-a77f-c1141c3fb510 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-47fe1958-76d1-473d-aaaa-0aed66f07f56 req-6a2af4cd-0491-4e55-a77f-c1141c3fb510 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-47fe1958-76d1-473d-aaaa-0aed66f07f56 req-6a2af4cd-0491-4e55-a77f-c1141c3fb510 tempest-AttachVolumeNegativeTest-2043106783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2358295-c882-40eb-b4bf-9bcf071c8932', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:55:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-47fe1958-76d1-473d-aaaa-0aed66f07f56 req-6a2af4cd-0491-4e55-a77f-c1141c3fb510 tempest-AttachVolumeNegativeTest-2043106783 None] attachment_update completed successfully. Jul 16 12:55:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fe1cdf21-b33d-407b-8ef9-cf32181de72e tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-1449321038: creating Jul 16 12:55:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fe1cdf21-b33d-407b-8ef9-cf32181de72e tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-1449321038: created successfully Jul 16 12:55:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fe1cdf21-b33d-407b-8ef9-cf32181de72e tempest-GroupSnapshotsTest-142894769 None] Create group completed successfully. Jul 16 12:55:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-87080029-5b41-4d48-80a0-a6dfdefa8e19 req-d63d14e5-90d0-497e-b376-7c240d6bddd6 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-87080029-5b41-4d48-80a0-a6dfdefa8e19 req-d63d14e5-90d0-497e-b376-7c240d6bddd6 tempest-TestStampPattern-795511305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-87080029-5b41-4d48-80a0-a6dfdefa8e19 req-d63d14e5-90d0-497e-b376-7c240d6bddd6 tempest-TestStampPattern-795511305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-87080029-5b41-4d48-80a0-a6dfdefa8e19 req-d63d14e5-90d0-497e-b376-7c240d6bddd6 tempest-TestStampPattern-795511305 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-540af084-f7b4-43df-98c2-a5a19495a720', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef5aedd0-7472-4529-9d7d-1213ec31352f', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:55:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-87080029-5b41-4d48-80a0-a6dfdefa8e19 req-d63d14e5-90d0-497e-b376-7c240d6bddd6 tempest-TestStampPattern-795511305 None] attachment_update completed successfully. Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (327a7ff2-88dc-4c7b-be30-ab2071f4b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073de985-3366-4620-be9c-39135dbefd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073de985-3366-4620-be9c-39135dbefd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207825206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49b68af1-dfad-4b47-ba89-d3105932f8e3,host='devstack@QuobyteHD#QuobyteHD',id=69f0dd00-13e5-445d-b245-8b081c8c1376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:38Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e2328c-8a37-4a53-8d08-e239ee3bb733),volume_type_id=91e2328c-8a37-4a53-8d08-e239ee3bb733)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7c4613-e6ad-4af0-bbc2-4d140cd08ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea7c4613-e6ad-4af0-bbc2-4d140cd08ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1926384f-9826-4894-b681-a94656b598a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1926384f-9826-4894-b681-a94656b598a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69f0dd00-13e5-445d-b245-8b081c8c1376', 'volume_name': 'volume-69f0dd00-13e5-445d-b245-8b081c8c1376', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853c2620-ce09-4851-937b-87046239b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853c2620-ce09-4851-937b-87046239b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a295fd-008c-4e0a-ac3f-e1d195ee5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Volume 69f0dd00-13e5-445d-b245-8b081c8c1376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69f0dd00-13e5-445d-b245-8b081c8c1376', 'volume_size': 1} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49b68af1-dfad-4b47-ba89-d3105932f8e3,created_at=2026-07-16T10:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1207825206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49b68af1-dfad-4b47-ba89-d3105932f8e3,host='devstack@QuobyteHD#QuobyteHD',id=69f0dd00-13e5-445d-b245-8b081c8c1376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:38Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91e2328c-8a37-4a53-8d08-e239ee3bb733),volume_type_id=91e2328c-8a37-4a53-8d08-e239ee3bb733)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Creating volume 69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:37 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:55:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:37 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 1073741824 Jul 16 12:55:37 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:38 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 1073741824" returned: 0 in 0.640s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:38 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:55:38 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:38 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a295fd-008c-4e0a-ac3f-e1d195ee5647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69f0dd00-13e5-445d-b245-8b081c8c1376', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17188979-342e-45c8-be26-57ba0b26663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Volume volume-69f0dd00-13e5-445d-b245-8b081c8c1376 (69f0dd00-13e5-445d-b245-8b081c8c1376): created successfully Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17188979-342e-45c8-be26-57ba0b26663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (327a7ff2-88dc-4c7b-be30-ab2071f4b077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b78a658a-0a65-40cb-be4d-c4b34e02a268 tempest-GroupSnapshotsTest-142894769 None] Created volume successfully. Jul 16 12:55:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] GroupSnapshot 11cfcba2-85a9-450d-8c89-5151490df640: creating. Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Group snapshot 11cfcba2-85a9-450d-8c89-5151490df640: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Creating offline snapshot ee4a0aac-54be-4dad-8ac8-018c4b96e10e of volume 69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df69128-e510-496a-bc3c-edb3268a9635]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:39 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:55:39 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:40 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 0.538s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:40 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e 1G Jul 16 12:55:40 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:40 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e 1G" returned: 0 in 0.874s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f0dd00-13e5-445d-b245-8b081c8c1376 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:40 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f0dd00-13e5-445d-b245-8b081c8c1376 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:55:40 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:41 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69f0dd00-13e5-445d-b245-8b081c8c1376 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 0.597s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:55:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:41 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:55:41 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:41 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:42 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info Jul 16 12:55:42 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-35544f03-2caa-408e-b1a6-82f96a721470 req-35199ebd-dc12-40f4-9961-30425b1e2ce1 tempest-TestStampPattern-795511305 None] Terminate volume connection completed successfully. Jul 16 12:55:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-35544f03-2caa-408e-b1a6-82f96a721470 req-35199ebd-dc12-40f4-9961-30425b1e2ce1 tempest-TestStampPattern-795511305 None] Deleting attachment ef5aedd0-7472-4529-9d7d-1213ec31352f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:55:42 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info" returned: 0 in 0.473s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:55:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:42 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info Jul 16 12:55:42 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:43 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.info" returned: 0 in 0.553s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.572s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Creating offline snapshot 53592042-6ddf-41bd-a2d5-e3088ba9bbd5 of volume 540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[341c1d6d-a6c0-4b26-bd33-436e58177009]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ac336cc4-3fb0-4abf-a6a2-7d55dde3332d tempest-GroupSnapshotsTest-142894769 None] group_snapshot 11cfcba2-85a9-450d-8c89-5151490df640: created successfully Jul 16 12:55:43 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:55:43 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:43 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:43 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 1G Jul 16 12:55:43 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:44 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 1G" returned: 0 in 0.676s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540af084-f7b4-43df-98c2-a5a19495a720 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:44 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540af084-f7b4-43df-98c2-a5a19495a720 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:55:44 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:45 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-540af084-f7b4-43df-98c2-a5a19495a720 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.627s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:45 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 is being set with open permissions: ugo+rw Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:45 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:55:45 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:45 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:45 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info Jul 16 12:55:45 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:45 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:45 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info is being set with open permissions: ugo+rw Jul 16 12:55:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:45 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info Jul 16 12:55:45 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:46 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.info" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.127s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Creating volume 14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 from snapshot ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e9efb35b-270d-47e5-8279-980247b0b5c3 tempest-TestStampPattern-795511305 None] Create snapshot completed successfully Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] snapshot: ee4a0aac-54be-4dad-8ac8-018c4b96e10e, volume: 14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e1e8d-2d87-49ee-a3d1-79b933eda366]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:46 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:55:46 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:46 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 0.715s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f0dd00-13e5-445d-b245-8b081c8c1376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4721bc8f-f131-43db-bf0c-fff69a145e52]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:47 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:55:47 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:47 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 0.705s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:55:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:47 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 Jul 16 12:55:47 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" returned: 0 in 7.694s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf29fec-0b55-471a-9825-2164fa45310d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:55 devstack sudo[96366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:55:55 devstack sudo[96366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:56 devstack sudo[96366]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 0.685s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376, size 1024.00 MB, duration 7.70 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:55:56 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Converted 1024.00 MB image at 133.01 MB/s Jul 16 12:55:56 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:56 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 Jul 16 12:55:56 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=43,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=41,cinder:SELECT=48,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:55:56 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" released by "_copy_volume_from_snapshot" :: held 10.241s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" released by "_create_volume_from_snapshot" :: held 10.306s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.337s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0e855c5a-8ec7-42ba-8ddd-0eaa92db700c tempest-GroupSnapshotsTest-142894769 None] Create group from source-snapshot-11cfcba2-85a9-450d-8c89-5151490df640 completed successfully. Jul 16 12:55:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf013c0d-3ec1-43b6-ac6d-9452e33b7b80]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:58 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 Jul 16 12:55:58 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:58 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:58 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6 Jul 16 12:55:58 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:58 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-14a2dd0c-09fb-41ec-b54f-ea2d4abb27e6" released by "delete_volume" :: held 0.905s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Created reservations ['7c39384f-d776-41f6-9e3c-b246623c6b15'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:55:59 devstack cinder-volume[87560]: WARNING cinder.quota [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1375287126 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1375287126, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:55:59 devstack cinder-volume[87560]: WARNING cinder.quota [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1375287126 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1375287126, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Created reservations ['9e7c59b8-7ae2-44da-b7f1-72500a6c5f9e', '1d4f7f24-aa3e-4054-beba-57acf53830f6', '09cbb817-35ae-417d-8b9c-54cac33c3aba', '7d12c6af-584f-4a33-969a-2be9e1c4e061'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Flow 'volume_create_manager' (cfe624b5-a0d4-47ca-a899-2529d59e7c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61defb6-8683-4cae-9694-7b756074fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61defb6-8683-4cae-9694-7b756074fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-545165392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1045fd-7fd6-4f5d-abae-1168aaaa9d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cffec697b5a842b9bac88acc2bcc811d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53592042-6ddf-41bd-a2d5-e3088ba9bbd5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:55:59Z,use_quota=True,user_id='af67af83dd08414f8abbc3148531befe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9728e98-33d6-4842-a567-94159722a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9728e98-33d6-4842-a567-94159722a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2f6cb8-bc8f-4c5f-ad67-06cc0a2610bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2f6cb8-bc8f-4c5f-ad67-06cc0a2610bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c1045fd-7fd6-4f5d-abae-1168aaaa9d89', 'volume_name': 'volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89', 'volume_size': 1, 'snapshot_id': '53592042-6ddf-41bd-a2d5-e3088ba9bbd5'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020df4ea-cef3-4bec-8185-d77979b14240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020df4ea-cef3-4bec-8185-d77979b14240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf812e8-2c20-4104-88db-2cdc772ad6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:55:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Volume 9c1045fd-7fd6-4f5d-abae-1168aaaa9d89: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89', 'volume_size': 1, 'snapshot_id': '53592042-6ddf-41bd-a2d5-e3088ba9bbd5'} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Creating volume 9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 from snapshot 53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] snapshot: 53592042-6ddf-41bd-a2d5-e3088ba9bbd5, volume: 9c1045fd-7fd6-4f5d-abae-1168aaaa9d89, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6133ae4-56f8-489d-8837-dd71700423ce]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:55:59 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:55:59 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:59 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:55:59 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:55:59 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:55:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:55:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8f910e40-e1ce-43f6-98f5-f70e9d02df5f tempest-GroupSnapshotsTest-142894769 None] Delete group completed successfully. Jul 16 12:56:00 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-540af084-f7b4-43df-98c2-a5a19495a720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c89c0f-dd61-42bc-8070-7f0df87703cc]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:00 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:56:00 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] group_snapshot 11cfcba2-85a9-450d-8c89-5151490df640: deleting Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] group_snapshot 11cfcba2-85a9-450d-8c89-5151490df640: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:00 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.554s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:00 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 Jul 16 12:56:00 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Deleting offline snapshot ee4a0aac-54be-4dad-8ac8-018c4b96e10e of volume 69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] snapshot_file for this snap is: volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7db4638-5dcd-404c-9787-72dc9bef023f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:00 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:56:00 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:01 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 0.818s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69f0dd00-13e5-445d-b245-8b081c8c1376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff325863-c537-4868-b35b-8d369149e7f0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:01 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:56:01 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:02 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 1.027s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:02 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:56:02 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:04 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 1.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:04 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e Jul 16 12:56:04 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:04 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376.ee4a0aac-54be-4dad-8ac8-018c4b96e10e" returned: 0 in 0.613s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee4a0aac-54be-4dad-8ac8-018c4b96e10e" released by "_delete_snapshot" :: held 4.197s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" released by "delete_snapshot" :: held 4.293s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:05 devstack cinder-volume[87560]: WARNING cinder.quota [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1375287126 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1375287126, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] Created reservations ['42c888c2-2bb2-49ac-bbdf-c88d75a4fad8', '5294ea39-7021-40f8-bfb1-63cdcc9a0672', 'b319b928-fd49-4dc2-8813-d979e83cda65', '3cfaca1a-6481-4461-9f0b-b61310de2a13'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-193ca8d8-bf76-4cc8-adbe-ea2830188569 tempest-GroupSnapshotsTest-142894769 None] group_snapshot 11cfcba2-85a9-450d-8c89-5151490df640: deleted successfully Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" acquired by "delete_volume" :: waited 0.103s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5cae2b-5016-442a-b2eb-a3cb9be9f87d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:08 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:08 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:09 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:56:09 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:10 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 1.699s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:56:10 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 2.552s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:10 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376 Jul 16 12:56:10 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:11 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" returned: 0 in 10.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[51791109-d5c9-469c-bb5a-1d3006207e57]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:11 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:56:11 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (f90424ba-c2a6-460f-9ed9-ae8fbedc3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:12 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f69a23c-f780-436a-8274-f6ecb4d8fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-69f0dd00-13e5-445d-b245-8b081c8c1376" returned: 0 in 1.170s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f69a23c-f780-436a-8274-f6ecb4d8fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387321847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3337270-c5f3-43a9-b1dc-1515f9681c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:12Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d848863e-2da7-4619-a781-6d5d32b812d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d848863e-2da7-4619-a781-6d5d32b812d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6bf91-1f51-4d44-ac36-2e2323a06ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e6bf91-1f51-4d44-ac36-2e2323a06ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3337270-c5f3-43a9-b1dc-1515f9681c35', 'volume_name': 'volume-a3337270-c5f3-43a9-b1dc-1515f9681c35', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6823af-f701-4e7b-90b7-881a648d2e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6823af-f701-4e7b-90b7-881a648d2e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8bbce1-8603-48ec-b0f5-908d208e090d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Volume a3337270-c5f3-43a9-b1dc-1515f9681c35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3337270-c5f3-43a9-b1dc-1515f9681c35', 'volume_size': 1} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-69f0dd00-13e5-445d-b245-8b081c8c1376" released by "delete_volume" :: held 4.148s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Created reservations ['456a2367-bea2-4d88-a1ab-262a497e7d8e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:12 devstack cinder-volume[87560]: WARNING cinder.db.api [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1375287126'] Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Created reservations ['1b3574e3-28f1-4fef-a46f-6cd8308f1799', 'a884ed92-84c4-45ed-9635-6395bc348888', 'a20cb4b8-9043-4ce4-a35f-fdb910daaa90', '99efed7c-5697-4e49-b2b3-9fb57e6094e4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:12 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 1.594s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720, size 1024.00 MB, duration 10.52 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:56:12 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Converted 1024.00 MB image at 97.35 MB/s Jul 16 12:56:12 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 is being set with open permissions: ugo+rw Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:12 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 Jul 16 12:56:12 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:12 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:12 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:13 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:13 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" returned: 0 in 0.948s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.872s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" released by "_copy_volume_from_snapshot" :: held 14.344s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c3a2c1a-3bd0-4c25-a244-1d059b98cb3d tempest-GroupSnapshotsTest-142894769 None] Delete group completed successfully. Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" released by "_create_volume_from_snapshot" :: held 14.447s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.481s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1387321847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3337270-c5f3-43a9-b1dc-1515f9681c35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:12Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Creating volume a3337270-c5f3-43a9-b1dc-1515f9681c35 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:13 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 1073741824 Jul 16 12:56:13 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf812e8-2c20-4104-88db-2cdc772ad6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89', 'volume_size': 1, 'snapshot_id': '53592042-6ddf-41bd-a2d5-e3088ba9bbd5'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f93363-b701-4afd-906d-b1fd8ced6e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Volume volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 (9c1045fd-7fd6-4f5d-abae-1168aaaa9d89): created successfully Jul 16 12:56:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f93363-b701-4afd-906d-b1fd8ced6e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Flow 'volume_create_manager' (cfe624b5-a0d4-47ca-a899-2529d59e7c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7005ce24-c1bd-422e-af0b-c07ed0b9a361 tempest-TestStampPattern-795511305 None] Created volume successfully. Jul 16 12:56:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9462bbdd-5d2e-4675-a6c8-1a7e4d0aaf86 tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-1400350881: creating Jul 16 12:56:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9462bbdd-5d2e-4675-a6c8-1a7e4d0aaf86 tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-1400350881: created successfully Jul 16 12:56:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9462bbdd-5d2e-4675-a6c8-1a7e4d0aaf86 tempest-GroupSnapshotsTest-142894769 None] Create group completed successfully. Jul 16 12:56:15 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 1073741824" returned: 0 in 1.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:15 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 Jul 16 12:56:15 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:15 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35" returned: 0 in 0.345s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8bbce1-8603-48ec-b0f5-908d208e090d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3337270-c5f3-43a9-b1dc-1515f9681c35', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f37bd-3201-4ab7-984a-a72919dea6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Volume volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 (a3337270-c5f3-43a9-b1dc-1515f9681c35): created successfully Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f37bd-3201-4ab7-984a-a72919dea6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (f90424ba-c2a6-460f-9ed9-ae8fbedc3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-595bfb78-f418-42bf-a441-456d9d332d2a tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6db7b993-51a0-4ca9-a6ab-ec2a3f815113 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6db7b993-51a0-4ca9-a6ab-ec2a3f815113 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35" acquired by "attach_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6db7b993-51a0-4ca9-a6ab-ec2a3f815113 tempest-VolumesActionsTest-38041959 None] Attaching volume a3337270-c5f3-43a9-b1dc-1515f9681c35 to instance 1ded6384-445e-4f7e-80ff-91e3f3b0a912 at mountpoint /dev/vdb on host None. Jul 16 12:56:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6db7b993-51a0-4ca9-a6ab-ec2a3f815113 tempest-VolumesActionsTest-38041959 None] Attach volume completed successfully. Jul 16 12:56:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6db7b993-51a0-4ca9-a6ab-ec2a3f815113 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35" released by "attach_volume" :: held 0.277s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (364a6e58-2cc9-4ce4-afcf-d8f08bafbf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19373159-9711-47bd-84bc-41dc81896b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19373159-9711-47bd-84bc-41dc81896b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488032647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5847f96-3224-480a-8d28-a0f10e97edc3,host='devstack@QuobyteHD#QuobyteHD',id=726c2732-5584-4411-b454-71d7f7bc8d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:17Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(841c5c28-6779-4a04-bc41-d2f798e1a3b9),volume_type_id=841c5c28-6779-4a04-bc41-d2f798e1a3b9)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8609ad78-a413-46ab-91b4-163b957d5d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8609ad78-a413-46ab-91b4-163b957d5d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56deaf00-de38-449f-a114-cb05dee1bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56deaf00-de38-449f-a114-cb05dee1bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726c2732-5584-4411-b454-71d7f7bc8d90', 'volume_name': 'volume-726c2732-5584-4411-b454-71d7f7bc8d90', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1456ca0c-055d-4de8-bb31-a644bb21bae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1456ca0c-055d-4de8-bb31-a644bb21bae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90efdc52-f68d-466d-96e1-328015439870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Volume 726c2732-5584-4411-b454-71d7f7bc8d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726c2732-5584-4411-b454-71d7f7bc8d90', 'volume_size': 1} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5847f96-3224-480a-8d28-a0f10e97edc3,created_at=2026-07-16T10:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-488032647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5847f96-3224-480a-8d28-a0f10e97edc3,host='devstack@QuobyteHD#QuobyteHD',id=726c2732-5584-4411-b454-71d7f7bc8d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:17Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(841c5c28-6779-4a04-bc41-d2f798e1a3b9),volume_type_id=841c5c28-6779-4a04-bc41-d2f798e1a3b9)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Creating volume 726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:17 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:17 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 1073741824 Jul 16 12:56:17 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Terminate volume connection completed successfully. Jul 16 12:56:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Detaching volume a3337270-c5f3-43a9-b1dc-1515f9681c35 from instance 1ded6384-445e-4f7e-80ff-91e3f3b0a912. Jul 16 12:56:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Detach volume completed successfully. Jul 16 12:56:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0db12867-a3cc-45da-8c53-b86fd8b5b3a0 tempest-VolumesActionsTest-163718170 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" released by "detach_volume" :: held 0.331s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:18 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 1073741824" returned: 0 in 1.228s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:19 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 Jul 16 12:56:19 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85aeba74-850e-42f9-a1d3-b0f4b3f30f00 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85aeba74-850e-42f9-a1d3-b0f4b3f30f00 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-85aeba74-850e-42f9-a1d3-b0f4b3f30f00 tempest-VolumesActionsTest-38041959 None] Volume detach called, but volume not attached. Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85aeba74-850e-42f9-a1d3-b0f4b3f30f00 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:19 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90" returned: 0 in 0.687s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90efdc52-f68d-466d-96e1-328015439870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726c2732-5584-4411-b454-71d7f7bc8d90', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7b9645-0cc3-48c8-be67-e5a5d69fb377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Volume volume-726c2732-5584-4411-b454-71d7f7bc8d90 (726c2732-5584-4411-b454-71d7f7bc8d90): created successfully Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7b9645-0cc3-48c8-be67-e5a5d69fb377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (364a6e58-2cc9-4ce4-afcf-d8f08bafbf5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-416cfc54-d2a6-481d-84cf-2305ee63539e tempest-GroupSnapshotsTest-142894769 None] Created volume successfully. Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-quobyte-a3337270-c5f3-43a9-b1dc-1515f9681c35" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "cinder-quobyte-a3337270-c5f3-43a9-b1dc-1515f9681c35" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7cdc9b-6a79-4e8d-8477-018de8466ded]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:20 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 Jul 16 12:56:20 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:20 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35" returned: 0 in 0.945s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:20 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35 Jul 16 12:56:20 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-a205d5d3-daae-4722-8d32-77256e9b74e5 req-460a56f7-6548-45de-b9a9-2d250bf30488 tempest-AttachVolumeNegativeTest-2043106783 None] Terminate volume connection completed successfully. Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-a205d5d3-daae-4722-8d32-77256e9b74e5 req-460a56f7-6548-45de-b9a9-2d250bf30488 tempest-AttachVolumeNegativeTest-2043106783 None] Deleting attachment f2358295-c882-40eb-b4bf-9bcf071c8932. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:56:21 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a3337270-c5f3-43a9-b1dc-1515f9681c35" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "cinder-quobyte-a3337270-c5f3-43a9-b1dc-1515f9681c35" released by "delete_volume" :: held 1.470s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Created reservations ['74dd37a8-760f-4477-9ec2-a0e168f30039', '9f42e554-0bd2-43d3-9efa-651608ab9331', '419983d4-9200-4aa1-9a6f-337ca986323e', '6d368a1a-f984-42bb-b680-0fd8b87df5ae'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:21 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:21 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:21 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:21 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Deleted volume successfully. Jul 16 12:56:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9f9ba507-1880-444f-b0c9-9a98994202f6 tempest-VolumesActionsTest-38041959 None] Lock "cinder-a3337270-c5f3-43a9-b1dc-1515f9681c35-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (89324545-62d6-4ab0-a620-0f95ea06af93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9916a-f7f1-4254-a2a6-9f961a1ae818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a9916a-f7f1-4254-a2a6-9f961a1ae818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410682225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5847f96-3224-480a-8d28-a0f10e97edc3,host='devstack@QuobyteHD#QuobyteHD',id=42546d91-c074-4f2b-b07c-a75a95ea2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:23Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(841c5c28-6779-4a04-bc41-d2f798e1a3b9),volume_type_id=841c5c28-6779-4a04-bc41-d2f798e1a3b9)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4030b25-3458-4142-9729-c6f282ce56f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4030b25-3458-4142-9729-c6f282ce56f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68680379-8855-44c9-8b6d-ead6628b84b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68680379-8855-44c9-8b6d-ead6628b84b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42546d91-c074-4f2b-b07c-a75a95ea2e1b', 'volume_name': 'volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f0a5ea-3ec8-4cc4-82ce-3b7e74482657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f0a5ea-3ec8-4cc4-82ce-3b7e74482657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc94befe-6962-49de-b48a-b98ae46ca7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Volume 42546d91-c074-4f2b-b07c-a75a95ea2e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b', 'volume_size': 1} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c5847f96-3224-480a-8d28-a0f10e97edc3,created_at=2026-07-16T10:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1410682225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c5847f96-3224-480a-8d28-a0f10e97edc3,host='devstack@QuobyteHD#QuobyteHD',id=42546d91-c074-4f2b-b07c-a75a95ea2e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:23Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(841c5c28-6779-4a04-bc41-d2f798e1a3b9),volume_type_id=841c5c28-6779-4a04-bc41-d2f798e1a3b9)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Creating volume 42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:23 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b 1073741824 Jul 16 12:56:23 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:24 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b 1073741824" returned: 0 in 0.673s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:24 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b Jul 16 12:56:24 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:24 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b" returned: 0 in 0.530s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc94befe-6962-49de-b48a-b98ae46ca7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba114dc-c876-4e75-941c-888b38e6c71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Volume volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b (42546d91-c074-4f2b-b07c-a75a95ea2e1b): created successfully Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba114dc-c876-4e75-941c-888b38e6c71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (89324545-62d6-4ab0-a620-0f95ea06af93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ed09e3c5-3a71-4581-b0fe-b2a8240e6356 tempest-GroupSnapshotsTest-142894769 None] Created volume successfully. Jul 16 12:56:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a4c46bf4-5853-430e-b2da-f937f423d46a tempest-GroupSnapshotsTest-142894769 None] Update group completed successfully. Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (41c97998-049b-4fb3-a7ec-0309eed57576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2fdbc-0adb-4b3f-983f-8d9a86e300fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2fdbc-0adb-4b3f-983f-8d9a86e300fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293749623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b816ed-2425-4a8b-856a-f32280f8ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:27Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bcd7c4-34ed-4734-a5f5-3d0f5faa5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bcd7c4-34ed-4734-a5f5-3d0f5faa5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4494eb3f-1e81-4790-ad43-6c1c8d1dde77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4494eb3f-1e81-4790-ad43-6c1c8d1dde77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b816ed-2425-4a8b-856a-f32280f8ba54', 'volume_name': 'volume-a0b816ed-2425-4a8b-856a-f32280f8ba54', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86d430d-324b-4323-b763-44ff85b5407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86d430d-324b-4323-b763-44ff85b5407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b601b6-fcff-4a5d-9d16-ad470e422f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Volume a0b816ed-2425-4a8b-856a-f32280f8ba54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b816ed-2425-4a8b-856a-f32280f8ba54', 'volume_size': 1} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1293749623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b816ed-2425-4a8b-856a-f32280f8ba54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:27Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Creating volume a0b816ed-2425-4a8b-856a-f32280f8ba54 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:27 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 1073741824 Jul 16 12:56:27 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eaa2e66d-fa68-443f-a51f-fb5e966d920d tempest-GroupSnapshotsTest-142894769 None] Update group completed successfully. Jul 16 12:56:27 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 1073741824" returned: 0 in 0.687s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:28 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 Jul 16 12:56:28 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:28 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b601b6-fcff-4a5d-9d16-ad470e422f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b816ed-2425-4a8b-856a-f32280f8ba54', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8976ea-b476-48ad-9b35-4aa87fe2d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Volume volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 (a0b816ed-2425-4a8b-856a-f32280f8ba54): created successfully Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8976ea-b476-48ad-9b35-4aa87fe2d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (41c97998-049b-4fb3-a7ec-0309eed57576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f8a11f14-3d0c-473c-85ce-0d418b9b3490 tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f2bb8297-183f-4d93-ad78-48ade19b5b7f tempest-GroupSnapshotsTest-142894769 None] Update group completed successfully. Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-a0b816ed-2425-4a8b-856a-f32280f8ba54-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "cinder-a0b816ed-2425-4a8b-856a-f32280f8ba54-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-quobyte-a0b816ed-2425-4a8b-856a-f32280f8ba54" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-a0b816ed-2425-4a8b-856a-f32280f8ba54" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[69824d39-fc66-4c21-821b-9ab97ba7136c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:29 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 Jul 16 12:56:29 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-64874415-530a-4d66-bbff-d548fdfadc3f tempest-GroupSnapshotsTest-142894769 None] Update group completed successfully. Jul 16 12:56:29 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:30 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54 Jul 16 12:56:30 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:30 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a0b816ed-2425-4a8b-856a-f32280f8ba54" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-a0b816ed-2425-4a8b-856a-f32280f8ba54" released by "delete_volume" :: held 0.807s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Created reservations ['74c56d0f-7138-4e51-9c14-00cf989b3aaf', 'a29541f8-fa59-4fe8-961c-8e5d06b785f2', 'cdad914b-864a-4bb0-a29f-a4137eeef089', '4ed03702-c945-4cd7-9c07-1981a4039468'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:30 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:30 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:30 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Deleted volume successfully. Jul 16 12:56:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa41c95d-a04c-4d40-952b-8e5ad2e7ed3e tempest-VolumesActionsTest-163718170 None] Lock "cinder-a0b816ed-2425-4a8b-856a-f32280f8ba54-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (a7eb272c-388f-43b8-8e60-0bbb7d40853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548c5574-2003-4579-9adf-62a43fb3dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548c5574-2003-4579-9adf-62a43fb3dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-591869134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47ffe87-3ec9-4dba-a55c-198a1d77c93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:31Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a744f-abe0-4d60-8075-42d3eaaa4737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958a744f-abe0-4d60-8075-42d3eaaa4737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795ac5c0-aac4-4657-910b-7aa1b467b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795ac5c0-aac4-4657-910b-7aa1b467b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f47ffe87-3ec9-4dba-a55c-198a1d77c93c', 'volume_name': 'volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab947246-3e2e-4a70-9392-c75fa10326c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab947246-3e2e-4a70-9392-c75fa10326c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334688e9-332a-4ba6-959d-896d2234fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Volume f47ffe87-3ec9-4dba-a55c-198a1d77c93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c', 'volume_size': 1} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-591869134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47ffe87-3ec9-4dba-a55c-198a1d77c93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:31Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Creating volume f47ffe87-3ec9-4dba-a55c-198a1d77c93c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:31 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:31 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c 1073741824 Jul 16 12:56:31 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] GroupSnapshot cd10cdaa-86cb-4d42-b267-db2307334504: creating. Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Group snapshot cd10cdaa-86cb-4d42-b267-db2307334504: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 12:56:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:32 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c 1073741824" returned: 0 in 0.586s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:32 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c Jul 16 12:56:32 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:32 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.648s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (334688e9-332a-4ba6-959d-896d2234fb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9fcfaa-f7c8-49c0-ae78-3bb5d82701f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Creating offline snapshot 8721aac2-b683-43fa-9ff0-59275d801a90 of volume 42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:56:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Volume volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c (f47ffe87-3ec9-4dba-a55c-198a1d77c93c): created successfully Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9fcfaa-f7c8-49c0-ae78-3bb5d82701f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (a7eb272c-388f-43b8-8e60-0bbb7d40853b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a69af-d480-4b1a-96e9-f2601501298f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-45ee7e0a-9be8-42b8-ab22-e852a6f5b0e0 tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:32 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b Jul 16 12:56:32 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:33 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b" returned: 0 in 0.480s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:33 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 1G Jul 16 12:56:33 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:33 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 1G" returned: 0 in 0.531s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:33 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 Jul 16 12:56:33 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-f47ffe87-3ec9-4dba-a55c-198a1d77c93c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "cinder-f47ffe87-3ec9-4dba-a55c-198a1d77c93c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-quobyte-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d002ec-77e0-40b7-91f3-a92f16a2f85d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90" returned: 0 in 0.494s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c Jul 16 12:56:34 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 Jul 16 12:56:34 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info Jul 16 12:56:34 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c Jul 16 12:56:34 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info Jul 16 12:56:34 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-f47ffe87-3ec9-4dba-a55c-198a1d77c93c" released by "delete_volume" :: held 0.784s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Created reservations ['cfa0c418-7d0f-4038-8075-816a620d0cf7', 'b3d30833-a9c6-4961-a99f-bf4eb7330fdb', 'f3acc99c-b86a-492d-8143-e835e50810df', 'b3bd7c03-fb03-474f-9dbd-a81718279ce4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:34 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:34 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:34 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.info" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Creating offline snapshot df251970-b1c8-42e6-945b-83ede2ccdd64 of volume 726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35e2354-8628-4dfc-912b-481e5394a847]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:35 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Deleted volume successfully. Jul 16 12:56:35 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 Jul 16 12:56:35 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40637032-66b3-4fc7-8a1d-99e10491cfe4 tempest-VolumesActionsTest-163718170 None] Lock "cinder-f47ffe87-3ec9-4dba-a55c-198a1d77c93c-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:35 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:35 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 1G Jul 16 12:56:35 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (361e65c1-f4a6-4d1f-9689-959080e4654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079f6a7d-5855-49c3-a585-2235e69781f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079f6a7d-5855-49c3-a585-2235e69781f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532533688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48358747-fc41-4914-81e2-16cdf6946aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:36Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b85447-dc59-464d-9df2-bb85adcd99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95b85447-dc59-464d-9df2-bb85adcd99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de5542-30d3-4c26-a92b-55b7468c840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48de5542-30d3-4c26-a92b-55b7468c840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48358747-fc41-4914-81e2-16cdf6946aba', 'volume_name': 'volume-48358747-fc41-4914-81e2-16cdf6946aba', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd0dc50-a2d8-4bac-aa26-417d5bd2494d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd0dc50-a2d8-4bac-aa26-417d5bd2494d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f32e2e-b6ea-4d26-b080-e63aabf63c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Volume 48358747-fc41-4914-81e2-16cdf6946aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48358747-fc41-4914-81e2-16cdf6946aba', 'volume_size': 1} Jul 16 12:56:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:36 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 1G" returned: 0 in 0.705s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c2732-5584-4411-b454-71d7f7bc8d90 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:36 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c2732-5584-4411-b454-71d7f7bc8d90 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 Jul 16 12:56:36 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:37 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726c2732-5584-4411-b454-71d7f7bc8d90 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64" returned: 0 in 0.821s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:37 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 Jul 16 12:56:37 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:37 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:37 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info Jul 16 12:56:37 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:37 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:37 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info Jul 16 12:56:37 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:37 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.info" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.112s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-532533688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48358747-fc41-4914-81e2-16cdf6946aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:36Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Creating volume 48358747-fc41-4914-81e2-16cdf6946aba {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:38 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba 1073741824 Jul 16 12:56:38 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b73b72a9-b79c-4303-9718-94ed4fa31540 tempest-GroupSnapshotsTest-142894769 None] group_snapshot cd10cdaa-86cb-4d42-b267-db2307334504: created successfully Jul 16 12:56:38 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba 1073741824" returned: 0 in 0.580s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:38 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba Jul 16 12:56:38 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:38 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f32e2e-b6ea-4d26-b080-e63aabf63c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48358747-fc41-4914-81e2-16cdf6946aba', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169026f-1d55-4d2f-a159-855cc4bb946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Volume volume-48358747-fc41-4914-81e2-16cdf6946aba (48358747-fc41-4914-81e2-16cdf6946aba): created successfully Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169026f-1d55-4d2f-a159-855cc4bb946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (361e65c1-f4a6-4d1f-9689-959080e4654f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6906a53b-1247-480e-ae2b-822ec998a66f tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] group_snapshot cd10cdaa-86cb-4d42-b267-db2307334504: deleting Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] group_snapshot cd10cdaa-86cb-4d42-b267-db2307334504: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-8721aac2-b683-43fa-9ff0-59275d801a90" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-8721aac2-b683-43fa-9ff0-59275d801a90" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Deleting offline snapshot 8721aac2-b683-43fa-9ff0-59275d801a90 of volume 42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] snapshot_file for this snap is: volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e2e2c8-6c77-488b-be13-15cccb17ef4d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:39 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 Jul 16 12:56:39 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-48358747-fc41-4914-81e2-16cdf6946aba-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "cinder-48358747-fc41-4914-81e2-16cdf6946aba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-quobyte-48358747-fc41-4914-81e2-16cdf6946aba" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:40 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90" returned: 0 in 0.630s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-48358747-fc41-4914-81e2-16cdf6946aba" acquired by "delete_volume" :: waited 0.053s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6544831-6e0e-43c8-b6ba-1e8f2965982b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94f354-7ad5-49c5-aad9-bbbd72eee6af]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:40 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b Jul 16 12:56:40 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:40 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba Jul 16 12:56:40 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:40 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:40 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:40 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba Jul 16 12:56:40 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:40 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 Jul 16 12:56:40 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:41 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-48358747-fc41-4914-81e2-16cdf6946aba" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-48358747-fc41-4914-81e2-16cdf6946aba" released by "delete_volume" :: held 0.705s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Created reservations ['a91b517b-305e-43b1-8656-bf8e3370c7d5', 'bf3c4958-8519-4c6b-9f64-bc6367bad5f2', '60accf25-a610-4af1-a4cd-c15892ab791d', '44dc0cf8-ca00-45a0-ba57-f8471f112743'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:41 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:41 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90 Jul 16 12:56:41 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:41 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:41 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:41 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b.8721aac2-b683-43fa-9ff0-59275d801a90" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-8721aac2-b683-43fa-9ff0-59275d801a90" released by "_delete_snapshot" :: held 1.826s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" released by "delete_snapshot" :: held 1.873s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:41 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Deleted volume successfully. Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-df251970-b1c8-42e6-945b-83ede2ccdd64" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-938170bd-787d-4229-b28f-07c84ff76815 tempest-VolumesActionsTest-163718170 None] Lock "cinder-48358747-fc41-4914-81e2-16cdf6946aba-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-df251970-b1c8-42e6-945b-83ede2ccdd64" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Deleting offline snapshot df251970-b1c8-42e6-945b-83ede2ccdd64 of volume 726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] snapshot_file for this snap is: volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5107d8e-b10f-46ff-a25e-ee4cafc4b52c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:41 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 Jul 16 12:56:41 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:41 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726c2732-5584-4411-b454-71d7f7bc8d90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd14b774-0885-4591-b06f-596dd18f5810]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (4581d2de-3766-46de-9af6-fdc3394cd619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa6bd2c-ce58-4a44-9565-f8a5f2272cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa6bd2c-ce58-4a44-9565-f8a5f2272cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760719304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b1600-c99d-4386-89af-67e57d352827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:42Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61617cf8-77a4-48bb-a779-9174b149426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61617cf8-77a4-48bb-a779-9174b149426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2465e476-44a5-43fa-ab25-02979a9b9702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2465e476-44a5-43fa-ab25-02979a9b9702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901b1600-c99d-4386-89af-67e57d352827', 'volume_name': 'volume-901b1600-c99d-4386-89af-67e57d352827', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f47f07-0507-47f1-80e1-9716f097975d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 Jul 16 12:56:42 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f47f07-0507-47f1-80e1-9716f097975d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc69123-3810-4308-9795-5940889521fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Volume 901b1600-c99d-4386-89af-67e57d352827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901b1600-c99d-4386-89af-67e57d352827', 'volume_size': 1} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1760719304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901b1600-c99d-4386-89af-67e57d352827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:42Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Creating volume 901b1600-c99d-4386-89af-67e57d352827 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:42 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 1073741824 Jul 16 12:56:42 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:42 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90" returned: 0 in 0.440s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:42 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 Jul 16 12:56:42 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:42 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 1073741824" returned: 0 in 0.441s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:42 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 Jul 16 12:56:42 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:42 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:42 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64 Jul 16 12:56:42 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:42 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc69123-3810-4308-9795-5940889521fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901b1600-c99d-4386-89af-67e57d352827', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcd019-28fe-4931-a9a7-4ca45367efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Volume volume-901b1600-c99d-4386-89af-67e57d352827 (901b1600-c99d-4386-89af-67e57d352827): created successfully Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcd019-28fe-4931-a9a7-4ca45367efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (4581d2de-3766-46de-9af6-fdc3394cd619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fc567894-0e2b-4599-a65c-0c7ca184a07d tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:42 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90.df251970-b1c8-42e6-945b-83ede2ccdd64" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-df251970-b1c8-42e6-945b-83ede2ccdd64" released by "_delete_snapshot" :: held 1.513s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" released by "delete_snapshot" :: held 1.542s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:43 devstack cinder-volume[87560]: WARNING cinder.quota [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1581064887 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1581064887, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:43 devstack cinder-volume[87560]: WARNING cinder.quota [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1581064887 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1581064887, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Created reservations ['10213203-21af-4edc-96f5-c52d327dd40d', 'fe2c74d4-9724-4b50-8ae7-313f87cdb120', '99db718d-f651-4f4e-a5f2-6f9f68b83e54', 'bf1bf168-5ad8-4031-85fc-d09f2c7e3c4e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] Created reservations ['71c6103e-4749-4cf2-b001-f33cdb338b6a', '320ddb20-f545-4e83-80bc-23c7e4e75576', '51300485-fdcc-47d8-a6ff-2b762d1739c3', '029b23e4-2864-46ba-b313-c43f1d2b912d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-85d92816-c179-455d-83a6-150a6cccd935 tempest-GroupSnapshotsTest-142894769 None] group_snapshot cd10cdaa-86cb-4d42-b267-db2307334504: deleted successfully Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-901b1600-c99d-4386-89af-67e57d352827-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "cinder-901b1600-c99d-4386-89af-67e57d352827-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Acquiring lock "cinder-quobyte-901b1600-c99d-4386-89af-67e57d352827" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-901b1600-c99d-4386-89af-67e57d352827" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1768f075-fc63-4076-93e4-dc2fc614f8df]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:44 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 Jul 16 12:56:44 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1f73c-89a0-4c94-b892-ef1f98a2ee18]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:44 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827" returned: 0 in 0.547s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:45 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827 Jul 16 12:56:45 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:45 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b Jul 16 12:56:45 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:45 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-901b1600-c99d-4386-89af-67e57d352827" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "cinder-quobyte-901b1600-c99d-4386-89af-67e57d352827" released by "delete_volume" :: held 0.905s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:45 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Created reservations ['41d3e7fe-4b13-470c-94be-761f1684cb69', '7441c80b-2fa8-4c6f-9be0-7293af786c7d', '6e76938a-ef0b-40bd-9abf-d0d55c1eb3b5', '1b6a2282-215c-44db-81d0-ab0ca6a4168a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:45 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b Jul 16 12:56:45 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:45 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:45 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:45 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-42546d91-c074-4f2b-b07c-a75a95ea2e1b" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-42546d91-c074-4f2b-b07c-a75a95ea2e1b" released by "delete_volume" :: held 1.091s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:45 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.436s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132aefb-595f-4557-9ec8-2cb5e0bb4811]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Deleted volume successfully. Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-837f2626-464b-4ca1-adce-1fd11e34b879 tempest-VolumesActionsTest-163718170 None] Lock "cinder-901b1600-c99d-4386-89af-67e57d352827-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:46 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 Jul 16 12:56:46 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (d6489052-58e4-4eaf-91cc-e8f3808884f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6cdd02-ed85-4eb1-8c2f-b1831fbab69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6cdd02-ed85-4eb1-8c2f-b1831fbab69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768631029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9529708-b858-4c9d-94b9-6a4b793d8046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:46Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4934a1b5-4502-49d1-a3c9-e7f5a8190cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4934a1b5-4502-49d1-a3c9-e7f5a8190cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550fc5d-812d-4a2f-9bf8-5fa6496e01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7550fc5d-812d-4a2f-9bf8-5fa6496e01e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9529708-b858-4c9d-94b9-6a4b793d8046', 'volume_name': 'volume-e9529708-b858-4c9d-94b9-6a4b793d8046', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16980d86-2b20-48e6-8767-5f849bf9702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16980d86-2b20-48e6-8767-5f849bf9702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8719a381-2c0d-4157-a815-e26e714b5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Volume e9529708-b858-4c9d-94b9-6a4b793d8046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9529708-b858-4c9d-94b9-6a4b793d8046', 'volume_size': 1} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1768631029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9529708-b858-4c9d-94b9-6a4b793d8046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='614b7b8d52e64511993b5ed2a9acd44b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:46Z,use_quota=True,user_id='58b864137bc54fa0bf5f33a8a8306c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Creating volume e9529708-b858-4c9d-94b9-6a4b793d8046 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:46 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:46 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90" returned: 0 in 0.531s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:46 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 1073741824 Jul 16 12:56:46 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:46 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90 Jul 16 12:56:46 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:46 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-726c2732-5584-4411-b454-71d7f7bc8d90" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-726c2732-5584-4411-b454-71d7f7bc8d90" released by "delete_volume" :: held 0.934s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Created reservations ['1ecf10e5-bd40-4dfb-be9d-933abc84eb29'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:46 devstack cinder-volume[87560]: WARNING cinder.quota [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1581064887 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1581064887, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Created reservations ['8e61ca68-be42-4c37-9360-350dbc853feb', 'e9e21d41-a733-46af-a37c-954fa7b75176', 'ab8f88a0-0a58-45ef-9b43-a6369b96d85e', '91064ad2-6229-4bf9-93a4-6183a55af1d7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:47 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 1073741824" returned: 0 in 0.535s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:47 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 Jul 16 12:56:47 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Created reservations ['b4858fe0-912e-473a-a042-7222a16a5174', 'eed766b7-e1fd-4f47-a618-86575c63cd83', '086cd1ca-efe1-4915-a27e-ba16697e637f', '392ce611-0314-4d45-9fc7-9808c8722adf'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:47 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:47 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:47 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8719a381-2c0d-4157-a815-e26e714b5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9529708-b858-4c9d-94b9-6a4b793d8046', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8219217b-967b-46a9-8e5a-6100d9c5a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Volume volume-e9529708-b858-4c9d-94b9-6a4b793d8046 (e9529708-b858-4c9d-94b9-6a4b793d8046): created successfully Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8219217b-967b-46a9-8e5a-6100d9c5a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Flow 'volume_create_manager' (d6489052-58e4-4eaf-91cc-e8f3808884f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7bdf36bf-6b5b-4bfa-9689-eaa92e28ca76 tempest-VolumesActionsTest-38041959 None] Created volume successfully. Jul 16 12:56:47 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-462d56da-8994-4977-a493-eaf15e54735d tempest-GroupSnapshotsTest-142894769 None] Delete group completed successfully. Jul 16 12:56:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70ba2cf2-90d8-4175-af57-4c849d57f899 tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-2095772386: creating Jul 16 12:56:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70ba2cf2-90d8-4175-af57-4c849d57f899 tempest-GroupSnapshotsTest-142894769 None] Group tempest-GroupSnapshotsTest-Group-2095772386: created successfully Jul 16 12:56:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70ba2cf2-90d8-4175-af57-4c849d57f899 tempest-GroupSnapshotsTest-142894769 None] Create group completed successfully. Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae99c85-ed4c-4feb-b2dd-41526d110c1a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-e9529708-b858-4c9d-94b9-6a4b793d8046-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "cinder-e9529708-b858-4c9d-94b9-6a4b793d8046-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Acquiring lock "cinder-quobyte-e9529708-b858-4c9d-94b9-6a4b793d8046" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:49 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "cinder-quobyte-e9529708-b858-4c9d-94b9-6a4b793d8046" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:49 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c61eb0c-2141-42ef-9b93-6f6dea178134]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:49 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 Jul 16 12:56:49 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:49 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.504s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a789be4-ec49-4d35-8f76-4d85b75e002a', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:56:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-df1f8d1f-d34b-4a5a-9f61-705b9ecb8509 req-752af02d-c204-4f75-a4a3-61bd88f89576 tempest-TestStampPattern-795511305 None] attachment_update completed successfully. Jul 16 12:56:49 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046" returned: 0 in 0.605s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:49 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046 Jul 16 12:56:49 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (d8d57830-d6d6-4f4b-97ab-2d3c7cb4545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd893e56-dece-42b3-b3ee-a9b589b2647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd893e56-dece-42b3-b3ee-a9b589b2647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687375414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6d979f5-98e8-46b2-882d-4500e7a845e6,host='devstack@QuobyteHD#QuobyteHD',id=ee79eabf-b238-4cd3-8929-557ce04972c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:50Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b0404a3-c280-4187-a980-08315c4c5301),volume_type_id=1b0404a3-c280-4187-a980-08315c4c5301)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d90f42-d945-48b3-acf3-b88d462694d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d90f42-d945-48b3-acf3-b88d462694d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb004b6-7e4e-4591-ba3a-f2cdb8811ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb004b6-7e4e-4591-ba3a-f2cdb8811ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee79eabf-b238-4cd3-8929-557ce04972c5', 'volume_name': 'volume-ee79eabf-b238-4cd3-8929-557ce04972c5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f5f14-2c76-45eb-9abc-4e43bb785c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f5f14-2c76-45eb-9abc-4e43bb785c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e7a175-2f44-400c-be14-6406be4da90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Volume ee79eabf-b238-4cd3-8929-557ce04972c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee79eabf-b238-4cd3-8929-557ce04972c5', 'volume_size': 1} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6d979f5-98e8-46b2-882d-4500e7a845e6,created_at=2026-07-16T10:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-687375414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6d979f5-98e8-46b2-882d-4500e7a845e6,host='devstack@QuobyteHD#QuobyteHD',id=ee79eabf-b238-4cd3-8929-557ce04972c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c2320bcd64a17bd4f5e3fbbb5a0a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:56:50Z,use_quota=True,user_id='a6d8b47011bd44ebbf025a0d5f1601c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b0404a3-c280-4187-a980-08315c4c5301),volume_type_id=1b0404a3-c280-4187-a980-08315c4c5301)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Creating volume ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:56:50 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:50 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 1073741824 Jul 16 12:56:50 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:50 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9529708-b858-4c9d-94b9-6a4b793d8046" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "cinder-quobyte-e9529708-b858-4c9d-94b9-6a4b793d8046" released by "delete_volume" :: held 1.066s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Created reservations ['28de8a05-4370-432d-90d9-3dca9d224c23', 'ca3faf27-c992-4f67-8ba1-8621c49da1bf', '6f80ac4e-4c51-44e6-93f0-9f1aba9ba5ef', '6e09c1d4-1acc-4970-8546-99ddb438fae7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:50 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:50 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:50 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Deleted volume successfully. Jul 16 12:56:50 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 1073741824" returned: 0 in 0.567s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc107109-96fb-4d9f-8789-1aa392000e58 tempest-VolumesActionsTest-38041959 None] Lock "cinder-e9529708-b858-4c9d-94b9-6a4b793d8046-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:50 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 Jul 16 12:56:50 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:51 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e7a175-2f44-400c-be14-6406be4da90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee79eabf-b238-4cd3-8929-557ce04972c5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72464c36-7155-4968-83a8-3802d1aeb9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:56:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Volume volume-ee79eabf-b238-4cd3-8929-557ce04972c5 (ee79eabf-b238-4cd3-8929-557ce04972c5): created successfully Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72464c36-7155-4968-83a8-3802d1aeb9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Flow 'volume_create_manager' (d8d57830-d6d6-4f4b-97ab-2d3c7cb4545c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:56:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b9672858-a350-4d21-86cd-f45df61ca323 tempest-GroupSnapshotsTest-142894769 None] Created volume successfully. Jul 16 12:56:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] GroupSnapshot 0559c885-0564-4925-a686-7794fd55336a: creating. Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Group snapshot 0559c885-0564-4925-a686-7794fd55336a: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Creating offline snapshot 2aa5548a-b6be-4bbf-8c2e-602f010c6b81 of volume ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bd838-32df-46d7-84e8-d11dbcd1e7eb]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:51 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 Jul 16 12:56:51 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:52 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:52 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 1G Jul 16 12:56:52 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:52 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 1G" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79eabf-b238-4cd3-8929-557ce04972c5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:52 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79eabf-b238-4cd3-8929-557ce04972c5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 Jul 16 12:56:52 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-de270c98-2634-463c-ad1f-27b077786426 req-84fe9f62-c409-4b3d-8ba5-76fffaee3f29 tempest-TestStampPattern-795511305 None] Terminate volume connection completed successfully. Jul 16 12:56:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-de270c98-2634-463c-ad1f-27b077786426 req-84fe9f62-c409-4b3d-8ba5-76fffaee3f29 tempest-TestStampPattern-795511305 None] Deleting attachment 2a789be4-ec49-4d35-8f76-4d85b75e002a. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:56:53 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee79eabf-b238-4cd3-8929-557ce04972c5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:53 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 Jul 16 12:56:53 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:53 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:53 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info Jul 16 12:56:53 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:53 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:53 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info Jul 16 12:56:53 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:53 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.info" returned: 0 in 0.319s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-92e92e77-8cca-4936-959e-9647f123269d tempest-GroupSnapshotsTest-142894769 None] group_snapshot 0559c885-0564-4925-a686-7794fd55336a: created successfully Jul 16 12:56:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] group_snapshot 0559c885-0564-4925-a686-7794fd55336a: deleting Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] group_snapshot 0559c885-0564-4925-a686-7794fd55336a: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-2aa5548a-b6be-4bbf-8c2e-602f010c6b81" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-2aa5548a-b6be-4bbf-8c2e-602f010c6b81" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Deleting offline snapshot 2aa5548a-b6be-4bbf-8c2e-602f010c6b81 of volume ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] snapshot_file for this snap is: volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1bea0e-8c4d-4bfc-8d8f-5397c3aba039]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:55 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 Jul 16 12:56:55 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:55 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81" returned: 0 in 0.450s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee79eabf-b238-4cd3-8929-557ce04972c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0499461-b00e-4a61-90b2-104b54948ed7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:56 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 Jul 16 12:56:56 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:56 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5" returned: 0 in 0.550s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:56 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 Jul 16 12:56:56 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:57 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:57 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81 Jul 16 12:56:57 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:57 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5.2aa5548a-b6be-4bbf-8c2e-602f010c6b81" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-2aa5548a-b6be-4bbf-8c2e-602f010c6b81" released by "_delete_snapshot" :: held 2.047s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "cinder-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=154,cinder:SELECT=137,cinder:INSERT=44,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" released by "delete_snapshot" :: held 2.102s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=154,cinder:SELECT=152,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaba3ce-f48d-4fc7-bd24-8f551285011b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:57 devstack cinder-volume[87560]: WARNING cinder.quota [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-184406749 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-184406749, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:57 devstack cinder-volume[87560]: WARNING cinder.quota [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-184406749 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-184406749, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:56:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] Created reservations ['63d42415-180c-4b55-9440-1ecb2b1789e4', '9a7566ec-4806-49ef-b244-b3fa5afc3d80', 'd9289bc0-2436-4650-9b59-144458340481', 'c8d6deb9-3bd1-4ab1-a4dc-f1013f5cdbdd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-98ca9dce-e295-46f3-8343-fc5b28c5e0ae tempest-GroupSnapshotsTest-142894769 None] group_snapshot 0559c885-0564-4925-a686-7794fd55336a: deleted successfully Jul 16 12:56:57 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 Jul 16 12:56:57 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:58 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" returned: 0 in 0.493s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:58 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89 Jul 16 12:56:58 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:58 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89" released by "delete_volume" :: held 0.831s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Created reservations ['18960673-14a6-4165-b3cf-569231c4b62f', '4df95847-55fa-4066-95d4-faa6e17eccc9', '9f2c77ce-601c-4794-bf8e-bd8af77709f7', 'c633cafb-0a7f-4cd6-b990-dc939759b1cf'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:58 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:56:58 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:58 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:56:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Deleted volume successfully. Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96145601-9d88-4b42-a070-3a7fbb041cc1 tempest-TestStampPattern-795511305 None] Lock "cinder-9c1045fd-7fd6-4f5d-abae-1168aaaa9d89-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:56:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Deleting offline snapshot 53592042-6ddf-41bd-a2d5-e3088ba9bbd5 of volume 540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] snapshot_file for this snap is: volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c3127-8eca-45ef-b024-20dc80caa2fa]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:56:59 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:56:59 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9196a4-c71c-4ee4-ba81-28f78bfead35]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:59 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 Jul 16 12:56:59 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:59 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.560s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-540af084-f7b4-43df-98c2-a5a19495a720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a143ad5-357e-4cf8-be76-b55d7f8d5f29]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:59 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5" returned: 0 in 0.503s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:56:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:56:59 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5 Jul 16 12:56:59 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:56:59 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:56:59 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:00 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ee79eabf-b238-4cd3-8929-557ce04972c5" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Lock "cinder-quobyte-ee79eabf-b238-4cd3-8929-557ce04972c5" released by "delete_volume" :: held 0.901s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (4f2f66dc-483d-4fb3-b366-0e6c062d3059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b59cbb-12ab-49fb-aeab-4aaa95445b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b59cbb-12ab-49fb-aeab-4aaa95445b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680643972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc53868-3133-4290-9efc-6d0a5a75ac2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:00Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080dbd58-1e5a-43ec-9740-37f1e9039f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:00 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080dbd58-1e5a-43ec-9740-37f1e9039f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5c4680-1433-4dcb-9bb2-0c36e8cc2fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5c4680-1433-4dcb-9bb2-0c36e8cc2fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc53868-3133-4290-9efc-6d0a5a75ac2c', 'volume_name': 'volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cf1c30-4fcc-4694-aa0c-9e1bd28abd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48cf1c30-4fcc-4694-aa0c-9e1bd28abd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6420d66d-c5dd-45fb-88a1-6a879d3ce0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Volume 7bc53868-3133-4290-9efc-6d0a5a75ac2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c', 'volume_size': 1} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680643972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc53868-3133-4290-9efc-6d0a5a75ac2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:00Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Creating volume 7bc53868-3133-4290-9efc-6d0a5a75ac2c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.560s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:00 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c 1073741824 Jul 16 12:57:00 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:00 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:57:00 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Created reservations ['23ffa969-27cc-4288-8784-a86272f804e0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:00 devstack cinder-volume[87560]: WARNING cinder.quota [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-184406749 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-184406749, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Created reservations ['5c0ef29c-2a2b-4e90-a83c-9fcdfdeb7a36', 'e4eda6a5-e607-4e20-9f96-e9e69dabfcd5', '610ccf0a-6775-4e18-b882-b39fffacd9a6', 'c06ef4e7-03cd-42df-b4ed-15399a9d23d3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:00 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:00 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:00 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.621s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:00 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c 1073741824" returned: 0 in 0.659s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:00 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5 Jul 16 12:57:00 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:00 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-699bc150-4f55-440e-b535-8efcc94edf36 tempest-GroupSnapshotsTest-142894769 None] Delete group completed successfully. Jul 16 12:57:00 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c Jul 16 12:57:00 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:01 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:01 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720.53592042-6ddf-41bd-a2d5-e3088ba9bbd5" returned: 0 in 0.319s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6420d66d-c5dd-45fb-88a1-6a879d3ce0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3440d606-853c-4bf9-84e3-8f9f4817dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-53592042-6ddf-41bd-a2d5-e3088ba9bbd5" released by "_delete_snapshot" :: held 2.194s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" released by "delete_snapshot" :: held 2.224s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Volume volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c (7bc53868-3133-4290-9efc-6d0a5a75ac2c): created successfully Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3440d606-853c-4bf9-84e3-8f9f4817dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (4f2f66dc-483d-4fb3-b366-0e6c062d3059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5613529f-fabb-4f6a-a24a-017261281860 tempest-AttachVolumeNegativeTest-2043106783 None] Created volume successfully. Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Created reservations ['fbb0f02f-218d-4ae1-bcb6-b6dd8fc113cc', '7487eea0-3304-4500-9cf0-1834af57d400', 'cf16fb50-a75f-426e-9fa2-e9a8b1e6feeb', '7718bbcf-7f52-456b-8f3a-fd64f75b533a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Delete snapshot completed successfully. Jul 16 12:57:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-22966ea6-7e8e-4cf1-9d2c-9df14c273981 tempest-TestStampPattern-795511305 None] Lock "cinder-53592042-6ddf-41bd-a2d5-e3088ba9bbd5-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1e3c910-eec6-40fa-b84c-fffaef2f849b req-11935be5-794c-477c-9b93-1253ca96f2d2 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1e3c910-eec6-40fa-b84c-fffaef2f849b req-11935be5-794c-477c-9b93-1253ca96f2d2 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b1e3c910-eec6-40fa-b84c-fffaef2f849b req-11935be5-794c-477c-9b93-1253ca96f2d2 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-b1e3c910-eec6-40fa-b84c-fffaef2f849b req-11935be5-794c-477c-9b93-1253ca96f2d2 tempest-AttachVolumeNegativeTest-2043106783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de443713-974b-4363-b898-965fb5e1be8d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:57:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-b1e3c910-eec6-40fa-b84c-fffaef2f849b req-11935be5-794c-477c-9b93-1253ca96f2d2 tempest-AttachVolumeNegativeTest-2043106783 None] attachment_update completed successfully. Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Flow 'volume_create_manager' (52c6b490-0792-4631-bc7a-b7c69e33c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3a514-1e5b-47a9-ac97-9bfc9397baaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e3a514-1e5b-47a9-ac97-9bfc9397baaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1551557995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f32f64-3aea-42ad-b462-6708cb37af17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea8c01d63b4ce5b44c8acf097bf9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:06Z,use_quota=True,user_id='dd701a5a149d4b80a2146a94d688078e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be614e-79b7-4f51-9a87-2af4fad11985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0be614e-79b7-4f51-9a87-2af4fad11985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7934fef4-e43e-4585-8462-19ad59ea686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 12:57:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-3264313f-58ed-49cf-bc97-347dd95fb0a9 req-af55a1a4-63ea-46d1-bf19-f462b5f11c63 tempest-AttachVolumeNegativeTest-2043106783 None] Terminate volume connection completed successfully. Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-3264313f-58ed-49cf-bc97-347dd95fb0a9 req-af55a1a4-63ea-46d1-bf19-f462b5f11c63 tempest-AttachVolumeNegativeTest-2043106783 None] Deleting attachment de443713-974b-4363-b898-965fb5e1be8d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-540af084-f7b4-43df-98c2-a5a19495a720-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "cinder-540af084-f7b4-43df-98c2-a5a19495a720-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Acquiring lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae94be-0886-4934-9086-5015db84a41e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:07 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:57:07 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7934fef4-e43e-4585-8462-19ad59ea686e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15f32f64-3aea-42ad-b462-6708cb37af17', 'volume_name': 'volume-15f32f64-3aea-42ad-b462-6708cb37af17', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb1cc8-8831-48e8-9fff-af4c063d2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb1cc8-8831-48e8-9fff-af4c063d2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf59563c-6c93-4615-afb0-33e1cc81f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Volume 15f32f64-3aea-42ad-b462-6708cb37af17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15f32f64-3aea-42ad-b462-6708cb37af17', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Trying to clone 15f32f64-3aea-42ad-b462-6708cb37af17 from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 12:57:07 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.531s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:07 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720 Jul 16 12:57:07 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:08 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-540af084-f7b4-43df-98c2-a5a19495a720" returned: 0 in 0.612s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "cinder-quobyte-540af084-f7b4-43df-98c2-a5a19495a720" released by "delete_volume" :: held 1.226s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 12:57:08 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Image download 20.69 MB at 20.69 MB/s Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Created reservations ['dd30f068-98d1-4851-ba2c-c96328bf04b1', '4f064c62-813d-475f-b3c5-bd79da6aa807', 'd47b0b50-d198-4c04-8eaf-822b023626f6', '1e75c0ea-6d25-4c0c-afe1-c555c20b7b8d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3685cd50-778e-4ea7-93f4-1ee331825dfe]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:08 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:08 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:08 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD Jul 16 12:57:08 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:08 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:08 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 is fetched for user dd701a5a149d4b80a2146a94d688078e. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 12:57:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Deleted volume successfully. Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9052e2f5-69e5-43cd-8810-528e16877b59 tempest-TestStampPattern-795511305 None] Lock "cinder-540af084-f7b4-43df-98c2-a5a19495a720-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:08 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:08 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837489c-859c-479a-9f3f-6b698a9534d7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:08 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD Jul 16 12:57:08 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:09 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:57:09 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1551557995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f32f64-3aea-42ad-b462-6708cb37af17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8ea8c01d63b4ce5b44c8acf097bf9e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:06Z,use_quota=True,user_id='dd701a5a149d4b80a2146a94d688078e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Creating volume 15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:09 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1073741824 Jul 16 12:57:09 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:10 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f36f381d-61df-4478-a956-c546cc760a60 tempest-GroupSnapshotsV319Test-2003139165 None] Group tempest-GroupSnapshotsV319Test-Group-1564174537: creating Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1073741824" returned: 0 in 0.732s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f36f381d-61df-4478-a956-c546cc760a60 tempest-GroupSnapshotsV319Test-2003139165 None] Group tempest-GroupSnapshotsV319Test-Group-1564174537: created successfully Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f36f381d-61df-4478-a956-c546cc760a60 tempest-GroupSnapshotsV319Test-2003139165 None] Create group completed successfully. Jul 16 12:57:10 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 Jul 16 12:57:10 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:10 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Attempting download of 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume 15f32f64-3aea-42ad-b462-6708cb37af17. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd1c056-4aab-48d6-8737-bdb3516eb6d9]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:10 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs Jul 16 12:57:10 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:10 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:11 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs Jul 16 12:57:11 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:11 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs" returned: 1 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_7cgj10bs' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c08fb1-412f-4439-9ee3-63c412ac20ff]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:11 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD Jul 16 12:57:11 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:11 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD" returned: 0 in 0.559s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:12 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 Jul 16 12:57:12 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Flow 'volume_create_manager' (1cf123c5-c4e9-437c-884f-30635112a93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bbe505-acdd-4f9e-9bd4-bf0532fe5605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7bbe505-acdd-4f9e-9bd4-bf0532fe5605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865969993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c36313c5-ac85-4e04-abf5-e20b7dc32ab2,host='devstack@QuobyteHD#QuobyteHD',id=85cefae9-c87e-4da0-b4bc-fc9e1d730b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19ab73484f491e8650a41fab05ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:12Z,use_quota=True,user_id='3cd7b872977444e4a40c081ba5c84e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca8da4f-86c8-4cbd-af33-979b434cb3fe),volume_type_id=cca8da4f-86c8-4cbd-af33-979b434cb3fe)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2979d2f3-bd1b-46b1-be7c-72ee89fae6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2979d2f3-bd1b-46b1-be7c-72ee89fae6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b881ce96-de52-417a-9292-3893a10ffbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b881ce96-de52-417a-9292-3893a10ffbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85cefae9-c87e-4da0-b4bc-fc9e1d730b7e', 'volume_name': 'volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf45c1df-0c45-456f-908b-368e39bd0cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf45c1df-0c45-456f-908b-368e39bd0cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f304d6d0-3d68-45e5-b254-89fa7aae0615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Volume 85cefae9-c87e-4da0-b4bc-fc9e1d730b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e', 'volume_size': 1} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c36313c5-ac85-4e04-abf5-e20b7dc32ab2,created_at=2026-07-16T10:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865969993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c36313c5-ac85-4e04-abf5-e20b7dc32ab2,host='devstack@QuobyteHD#QuobyteHD',id=85cefae9-c87e-4da0-b4bc-fc9e1d730b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af19ab73484f491e8650a41fab05ca7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:12Z,use_quota=True,user_id='3cd7b872977444e4a40c081ba5c84e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cca8da4f-86c8-4cbd-af33-979b434cb3fe),volume_type_id=cca8da4f-86c8-4cbd-af33-979b434cb3fe)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Creating volume 85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:12 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e 1073741824 Jul 16 12:57:12 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:12 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e 1073741824" returned: 0 in 0.586s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:12 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e Jul 16 12:57:12 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:13 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f304d6d0-3d68-45e5-b254-89fa7aae0615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dac810-5868-4358-98c7-c17c7c3f410a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Volume volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e (85cefae9-c87e-4da0-b4bc-fc9e1d730b7e): created successfully Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dac810-5868-4358-98c7-c17c7c3f410a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Flow 'volume_create_manager' (1cf123c5-c4e9-437c-884f-30635112a93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-addecc3e-6303-4b20-9e21-ff7361218e6f tempest-GroupSnapshotsV319Test-2003139165 None] Created volume successfully. Jul 16 12:57:14 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17" returned: 0 in 2.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_63iecgi2devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:57:14 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Converted 112.00 MB image at 47.77 MB/s Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:14 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1G Jul 16 12:57:14 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] GroupSnapshot 6919dd1b-71d1-4538-8196-75cb072091d3: creating. Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Group snapshot 6919dd1b-71d1-4538-8196-75cb072091d3: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 16 12:57:14 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 1G" returned: 0 in 0.568s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Downloaded image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume 15f32f64-3aea-42ad-b462-6708cb37af17 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 for user dd701a5a149d4b80a2146a94d688078e is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Marking volume 15f32f64-3aea-42ad-b462-6708cb37af17 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Creating offline snapshot 563da51d-6074-4ece-b9c0-ab3e6bcd70b5 of volume 85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Copying metadata from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 to 15f32f64-3aea-42ad-b462-6708cb37af17. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Creating volume glance metadata for volume 15f32f64-3aea-42ad-b462-6708cb37af17 backed by image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d169fe-748c-44cb-a6cc-28842c310617]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf59563c-6c93-4615-afb0-33e1cc81f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f32f64-3aea-42ad-b462-6708cb37af17', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f4e41e-3747-4b67-9a5d-a7aac2888b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Volume volume-15f32f64-3aea-42ad-b462-6708cb37af17 (15f32f64-3aea-42ad-b462-6708cb37af17): created successfully Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f4e41e-3747-4b67-9a5d-a7aac2888b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Flow 'volume_create_manager' (52c6b490-0792-4631-bc7a-b7c69e33c13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:15 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e Jul 16 12:57:15 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0dde2bce-a39c-42de-b86d-6150eb80690f tempest-VolumesImageMetadata-2017875856 None] Created volume successfully. Jul 16 12:57:15 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:15 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 1G Jul 16 12:57:15 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:15 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 1G" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:15 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 Jul 16 12:57:15 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:16 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:16 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:16 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 Jul 16 12:57:16 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:16 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Acquiring lock "cinder-15f32f64-3aea-42ad-b462-6708cb37af17-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:16 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info Jul 16 12:57:16 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "cinder-15f32f64-3aea-42ad-b462-6708cb37af17-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Acquiring lock "cinder-quobyte-15f32f64-3aea-42ad-b462-6708cb37af17" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "cinder-quobyte-15f32f64-3aea-42ad-b462-6708cb37af17" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[26870e7c-1bf4-4e5a-b9ef-9791e14b5801]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:16 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 Jul 16 12:57:16 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:17 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:17 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:17 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info Jul 16 12:57:17 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:17 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17" returned: 0 in 0.471s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:17 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17 Jul 16 12:57:17 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:17 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.info" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3e9b61f2-9f6a-41f8-ad26-cc48da16459f tempest-GroupSnapshotsV319Test-2003139165 None] group_snapshot 6919dd1b-71d1-4538-8196-75cb072091d3: created successfully Jul 16 12:57:17 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-15f32f64-3aea-42ad-b462-6708cb37af17" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "cinder-quobyte-15f32f64-3aea-42ad-b462-6708cb37af17" released by "delete_volume" :: held 0.886s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Created reservations ['93138e26-8f5e-444d-81bf-b6ad16175748', '709f2e3e-ac55-404e-a844-5b1ae505982d', '6c695479-1bcb-424b-9f72-41e99aec555e', 'b8bbf67d-68d1-4a30-ba26-61e8bd144c0d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:17 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:17 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:18 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.449s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Deleted volume successfully. Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-66cf15d2-2b99-476c-85fc-5306fe7a385f tempest-VolumesImageMetadata-2017875856 None] Lock "cinder-15f32f64-3aea-42ad-b462-6708cb37af17-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] group_snapshot 6919dd1b-71d1-4538-8196-75cb072091d3: deleting Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] group_snapshot 6919dd1b-71d1-4538-8196-75cb072091d3: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "cinder-quobyte-563da51d-6074-4ece-b9c0-ab3e6bcd70b5" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-563da51d-6074-4ece-b9c0-ab3e6bcd70b5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Deleting offline snapshot 563da51d-6074-4ece-b9c0-ab3e6bcd70b5 of volume 85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] snapshot_file for this snap is: volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607394a-2871-44a5-bb26-b4a3f3782bc4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:19 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 Jul 16 12:57:19 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:19 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5" returned: 0 in 0.554s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d68d842-2eb3-403e-a9c2-eab07792361a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:19 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e Jul 16 12:57:19 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:20 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:20 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 Jul 16 12:57:20 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:20 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:20 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5 Jul 16 12:57:20 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:20 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e.563da51d-6074-4ece-b9c0-ab3e6bcd70b5" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-563da51d-6074-4ece-b9c0-ab3e6bcd70b5" released by "_delete_snapshot" :: held 2.007s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" released by "delete_snapshot" :: held 2.040s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:21 devstack cinder-volume[87560]: WARNING cinder.quota [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1586661026 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1586661026, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:57:21 devstack cinder-volume[87560]: WARNING cinder.quota [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1586661026 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1586661026, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:57:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] Created reservations ['64f2bbf1-657f-47f5-aa8a-3d25c310c20e', 'cd09c545-2c1c-4882-8217-8427fae9455b', 'd98fee18-9dd7-457e-8229-b44346d63a9e', 'd9ff3a71-f2f3-4595-a74a-3128faff6036'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5c66e73e-5351-4896-af70-a236758a6ca2 tempest-GroupSnapshotsV319Test-2003139165 None] group_snapshot 6919dd1b-71d1-4538-8196-75cb072091d3: deleted successfully Jul 16 12:57:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9474389-7edf-45c3-b9e2-9ba9c20eb283]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:22 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e Jul 16 12:57:22 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:23 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" returned: 0 in 0.825s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:23 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e Jul 16 12:57:23 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:23 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "cinder-quobyte-85cefae9-c87e-4da0-b4bc-fc9e1d730b7e" released by "delete_volume" :: held 1.447s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Created reservations ['18d9afda-01a3-48b5-b0ee-eb7bb332c011'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:23 devstack cinder-volume[87560]: WARNING cinder.quota [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1586661026 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1586661026, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:57:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Created reservations ['37a7150b-c1df-4b1c-8876-7ba979a0d365', '9254b6c6-c421-40a8-b3a8-a7786fd025ca', 'ec99174c-fe8b-456c-b6ab-29839210d770', '6887cd74-3f46-4cbb-936d-3b0a01e0960f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:24 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:24 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:24 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.499s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3ebab3ff-82fc-441f-97c0-c3e8c9f75990 tempest-GroupSnapshotsV319Test-2003139165 None] Delete group completed successfully. Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Flow 'volume_create_manager' (202d5f73-fe16-4e44-92f0-23f79d18a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706afc7-5838-4f18-8dba-0bea350ea30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706afc7-5838-4f18-8dba-0bea350ea30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1476391251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf41645-f2a3-4088-8f49-d47269224704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e8a330ff98412f8b06971963415bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:25Z,use_quota=True,user_id='7fea3ab77d8c4b468195b3f1f2abc0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474ba040-cef7-40b9-a9bf-9b3f04137ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474ba040-cef7-40b9-a9bf-9b3f04137ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600618e2-46a5-4561-b3a3-8ab45a7a4b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600618e2-46a5-4561-b3a3-8ab45a7a4b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf41645-f2a3-4088-8f49-d47269224704', 'volume_name': 'volume-ddf41645-f2a3-4088-8f49-d47269224704', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18675a93-290d-4133-b80b-b061b42bedc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18675a93-290d-4133-b80b-b061b42bedc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b813134-d1e7-46d1-830c-4098ac455d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Volume ddf41645-f2a3-4088-8f49-d47269224704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf41645-f2a3-4088-8f49-d47269224704', 'volume_size': 1} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1476391251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf41645-f2a3-4088-8f49-d47269224704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89e8a330ff98412f8b06971963415bf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:25Z,use_quota=True,user_id='7fea3ab77d8c4b468195b3f1f2abc0ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Creating volume ddf41645-f2a3-4088-8f49-d47269224704 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:24 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 1073741824 Jul 16 12:57:24 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:25 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 1073741824" returned: 0 in 0.693s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:25 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 Jul 16 12:57:25 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:26 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704" returned: 0 in 0.528s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b813134-d1e7-46d1-830c-4098ac455d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf41645-f2a3-4088-8f49-d47269224704', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eed736-27d3-488c-b43d-a746edec3d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Volume volume-ddf41645-f2a3-4088-8f49-d47269224704 (ddf41645-f2a3-4088-8f49-d47269224704): created successfully Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eed736-27d3-488c-b43d-a746edec3d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Flow 'volume_create_manager' (202d5f73-fe16-4e44-92f0-23f79d18a51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-643e3b54-9039-4503-8a2c-e8b6937cee06 tempest-VolumesMetadataTest-576946847 None] Created volume successfully. Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (5dfde8fc-1265-4086-92e5-3057285062d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c95160-a5f1-45c4-a201-18edfa4bf1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c95160-a5f1-45c4-a201-18edfa4bf1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677843742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8f33bc-c3cf-42df-931d-38014efcde41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:27Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52d6495-7666-42b7-8b42-ee794ce9160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52d6495-7666-42b7-8b42-ee794ce9160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9fa4e3-7560-411e-8c8e-febc1de37df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9fa4e3-7560-411e-8c8e-febc1de37df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8f33bc-c3cf-42df-931d-38014efcde41', 'volume_name': 'volume-ae8f33bc-c3cf-42df-931d-38014efcde41', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8864bcff-e434-4699-8cef-640a348a5555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8864bcff-e434-4699-8cef-640a348a5555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af985efc-89fb-43cd-ba58-efabff16c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Volume ae8f33bc-c3cf-42df-931d-38014efcde41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8f33bc-c3cf-42df-931d-38014efcde41', 'volume_size': 1} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677843742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8f33bc-c3cf-42df-931d-38014efcde41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:27Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Creating volume ae8f33bc-c3cf-42df-931d-38014efcde41 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:27 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 1073741824 Jul 16 12:57:27 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (1d20189e-e5f7-455e-97b6-ac592a7f372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5597c7-f417-4fc1-bf4c-05ebb97daae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5597c7-f417-4fc1-bf4c-05ebb97daae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1358100155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d53c1-6e72-40fb-a158-b9baca07955a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:28Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90de0baf-5420-41af-94a5-0e93c222a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90de0baf-5420-41af-94a5-0e93c222a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e65606d-2a4d-4e58-9723-f0d60cd42975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e65606d-2a4d-4e58-9723-f0d60cd42975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275d53c1-6e72-40fb-a158-b9baca07955a', 'volume_name': 'volume-275d53c1-6e72-40fb-a158-b9baca07955a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01edc567-9ca0-4ef2-8c5e-278931d4910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01edc567-9ca0-4ef2-8c5e-278931d4910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c77bd6b-c24c-4c3b-a32f-f6007d4ad355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Volume 275d53c1-6e72-40fb-a158-b9baca07955a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275d53c1-6e72-40fb-a158-b9baca07955a', 'volume_size': 1} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:28 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (f91e9729-6b0d-435f-980b-499613f0207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad01952b-2eb1-4047-9406-f0eb6ca29ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Acquiring lock "cinder-ddf41645-f2a3-4088-8f49-d47269224704-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad01952b-2eb1-4047-9406-f0eb6ca29ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403863616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e4f56-01bd-4906-9438-13c39a5dd8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:29Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c89b539-34df-4404-aaeb-21a08d12fea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c89b539-34df-4404-aaeb-21a08d12fea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfcae5a-8b6a-4620-b36d-a55a62e63b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfcae5a-8b6a-4620-b36d-a55a62e63b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370e4f56-01bd-4906-9438-13c39a5dd8d8', 'volume_name': 'volume-370e4f56-01bd-4906-9438-13c39a5dd8d8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669b9782-e92b-4956-ac52-d819cd642fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669b9782-e92b-4956-ac52-d819cd642fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17329477-e5ec-47d1-b039-664fcc9e78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Volume 370e4f56-01bd-4906-9438-13c39a5dd8d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370e4f56-01bd-4906-9438-13c39a5dd8d8', 'volume_size': 1} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 1073741824" returned: 0 in 1.150s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "cinder-ddf41645-f2a3-4088-8f49-d47269224704-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Acquiring lock "cinder-quobyte-ddf41645-f2a3-4088-8f49-d47269224704" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "cinder-quobyte-ddf41645-f2a3-4088-8f49-d47269224704" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:29 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 Jul 16 12:57:29 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f5315-a727-429a-90a4-b68cc385eb61]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:29 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 Jul 16 12:57:29 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (5962a409-fea0-42ba-92d2-cd7a9c39d0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a843753e-e637-4612-860e-000a311fd13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a843753e-e637-4612-860e-000a311fd13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470296767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d14005-b183-4671-86ff-3e117e5ca80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:29Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7bdcc9-a118-4693-8bc5-0cc37082f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7bdcc9-a118-4693-8bc5-0cc37082f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc157753-0664-4ff2-beea-a067e7c7322d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc157753-0664-4ff2-beea-a067e7c7322d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d14005-b183-4671-86ff-3e117e5ca80a', 'volume_name': 'volume-53d14005-b183-4671-86ff-3e117e5ca80a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356398ba-fa0c-4316-99be-89fc2c343553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (356398ba-fa0c-4316-99be-89fc2c343553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed133e1c-5b8a-4fec-8636-86b6b898f8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Volume 53d14005-b183-4671-86ff-3e117e5ca80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d14005-b183-4671-86ff-3e117e5ca80a', 'volume_size': 1} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:29 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704" returned: 0 in 0.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:29 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41" returned: 0 in 0.622s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1358100155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=275d53c1-6e72-40fb-a158-b9baca07955a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:28Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Creating volume 275d53c1-6e72-40fb-a158-b9baca07955a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:29 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:29 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704 Jul 16 12:57:29 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af985efc-89fb-43cd-ba58-efabff16c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8f33bc-c3cf-42df-931d-38014efcde41', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a 1073741824 Jul 16 12:57:29 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04183ad3-2f19-44f3-adb5-8093e2691dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Volume volume-ae8f33bc-c3cf-42df-931d-38014efcde41 (ae8f33bc-c3cf-42df-931d-38014efcde41): created successfully Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04183ad3-2f19-44f3-adb5-8093e2691dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (5dfde8fc-1265-4086-92e5-3057285062d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fcc5272b-a1d6-4396-b90f-d059a79a078b tempest-CreateVolumesFromImageTest-80730461 None] Created volume successfully. Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (cbfa14d6-abf7-4940-ba79-f63eb7d9e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157107d1-3c05-48e4-82f5-11fd74159647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157107d1-3c05-48e4-82f5-11fd74159647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921111913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d944eb0-8942-4ba9-84d9-35d54f81be2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:30Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc44024e-164d-410b-967d-4cdf44bc5379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc44024e-164d-410b-967d-4cdf44bc5379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4d3c01-5e7b-4074-9d0d-0a16aff3b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4d3c01-5e7b-4074-9d0d-0a16aff3b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d944eb0-8942-4ba9-84d9-35d54f81be2e', 'volume_name': 'volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef402ca9-207f-4098-8573-9327efbcf952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef402ca9-207f-4098-8573-9327efbcf952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e65c6a8-79de-45d8-b14f-dc8d05760d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Volume 8d944eb0-8942-4ba9-84d9-35d54f81be2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e', 'volume_size': 1} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:30 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ddf41645-f2a3-4088-8f49-d47269224704" returned: 0 in 0.612s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "cinder-quobyte-ddf41645-f2a3-4088-8f49-d47269224704" released by "delete_volume" :: held 1.178s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Created reservations ['c974894e-b677-4cdf-9945-a0b737ce11fe', '90175132-d0ba-4adc-ba1a-6397cc78a740', '8cbd0825-c4ae-4709-82ff-f38faac787e3', '8fa7eb55-efab-4c70-a08e-94ba2eb981c4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:30 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:30 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:30 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a 1073741824" returned: 0 in 0.770s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:30 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a Jul 16 12:57:30 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:30 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Deleted volume successfully. Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7e30029d-b2a9-462d-8d22-141e674e8ca5 tempest-VolumesMetadataTest-576946847 None] Lock "cinder-ddf41645-f2a3-4088-8f49-d47269224704-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:30 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.845s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403863616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370e4f56-01bd-4906-9438-13c39a5dd8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:29Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Creating volume 370e4f56-01bd-4906-9438-13c39a5dd8d8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:30 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c77bd6b-c24c-4c3b-a32f-f6007d4ad355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275d53c1-6e72-40fb-a158-b9baca07955a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 1073741824 Jul 16 12:57:30 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfc95c4-36ab-4c34-8ca1-236f48cdab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Volume volume-275d53c1-6e72-40fb-a158-b9baca07955a (275d53c1-6e72-40fb-a158-b9baca07955a): created successfully Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cfc95c4-36ab-4c34-8ca1-236f48cdab9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (1d20189e-e5f7-455e-97b6-ac592a7f372e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3fcbaa28-5c1e-41e8-9d2b-dac23bb380be tempest-CreateVolumesFromImageTest-80730461 None] Created volume successfully. Jul 16 12:57:31 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 1073741824" returned: 0 in 0.582s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:31 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 Jul 16 12:57:31 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:31 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.349s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1470296767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d14005-b183-4671-86ff-3e117e5ca80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:29Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Creating volume 53d14005-b183-4671-86ff-3e117e5ca80a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:31 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17329477-e5ec-47d1-b039-664fcc9e78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370e4f56-01bd-4906-9438-13c39a5dd8d8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:31 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a 1073741824 Jul 16 12:57:31 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a530d7e-e08d-4dac-b694-d867b9955f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Volume volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 (370e4f56-01bd-4906-9438-13c39a5dd8d8): created successfully Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a530d7e-e08d-4dac-b694-d867b9955f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (f91e9729-6b0d-435f-980b-499613f0207f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-065f0a46-5b33-41b6-821d-226238c30ced tempest-CreateVolumesFromImageTest-80730461 None] Created volume successfully. Jul 16 12:57:32 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a 1073741824" returned: 0 in 0.623s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:32 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a Jul 16 12:57:32 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:32 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.670s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921111913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d944eb0-8942-4ba9-84d9-35d54f81be2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de557676a246454486dd38bfbf3e3b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:30Z,use_quota=True,user_id='0d7dab8e8a53404dacddf42992dca652',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Creating volume 8d944eb0-8942-4ba9-84d9-35d54f81be2e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:32 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed133e1c-5b8a-4fec-8636-86b6b898f8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d14005-b183-4671-86ff-3e117e5ca80a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:32 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e 1073741824 Jul 16 12:57:32 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aab2851-74d8-44cd-9294-feded26c46db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Volume volume-53d14005-b183-4671-86ff-3e117e5ca80a (53d14005-b183-4671-86ff-3e117e5ca80a): created successfully Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aab2851-74d8-44cd-9294-feded26c46db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (5962a409-fea0-42ba-92d2-cd7a9c39d0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7075c3d9-51af-44f7-9493-2bcbabc39bdc tempest-CreateVolumesFromImageTest-80730461 None] Created volume successfully. Jul 16 12:57:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34ad9601-f5e1-4102-b1c0-a7e33f66474e tempest-GroupsV320Test-867986162 None] Group tempest-GroupsV320Test-Group-368489143: creating Jul 16 12:57:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34ad9601-f5e1-4102-b1c0-a7e33f66474e tempest-GroupsV320Test-867986162 None] Group tempest-GroupsV320Test-Group-368489143: created successfully Jul 16 12:57:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34ad9601-f5e1-4102-b1c0-a7e33f66474e tempest-GroupsV320Test-867986162 None] Create group completed successfully. Jul 16 12:57:33 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e 1073741824" returned: 0 in 0.592s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:33 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e Jul 16 12:57:33 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:33 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e65c6a8-79de-45d8-b14f-dc8d05760d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945f856e-4be1-4e48-96e0-72643c1e8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Volume volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e (8d944eb0-8942-4ba9-84d9-35d54f81be2e): created successfully Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945f856e-4be1-4e48-96e0-72643c1e8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Flow 'volume_create_manager' (cbfa14d6-abf7-4940-ba79-f63eb7d9e413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-91dac39f-84fc-4d24-9268-cecb49363236 tempest-CreateVolumesFromImageTest-80730461 None] Created volume successfully. Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-8d944eb0-8942-4ba9-84d9-35d54f81be2e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-8d944eb0-8942-4ba9-84d9-35d54f81be2e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-quobyte-8d944eb0-8942-4ba9-84d9-35d54f81be2e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-8d944eb0-8942-4ba9-84d9-35d54f81be2e" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fda8b3-4644-4205-9720-89b25cf8638a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Created reservations ['98a74aee-9237-4495-8796-17d15ed4cba5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:35 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e Jul 16 12:57:35 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:35 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:35 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:35 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:35 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e" returned: 0 in 0.620s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.442s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-13777eeb-16b3-4aaa-8599-32dccda284d0 tempest-GroupsV320Test-867986162 None] Delete group completed successfully. Jul 16 12:57:35 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e Jul 16 12:57:35 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:35 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8d944eb0-8942-4ba9-84d9-35d54f81be2e" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-8d944eb0-8942-4ba9-84d9-35d54f81be2e" released by "delete_volume" :: held 1.010s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Created reservations ['309f4acb-492c-4d68-8440-2f4a2319bfe0', '32265d2d-d3b2-47ca-bb2e-74a885abd292', 'f49a5663-6303-44d2-a6dc-58d3c5c88c41', 'b3449250-a82b-444c-b3d1-7a085accce62'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:36 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:36 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.307s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Deleted volume successfully. Jul 16 12:57:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-18e16eee-3a71-43b8-b494-f14a47d6a3a5 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-8d944eb0-8942-4ba9-84d9-35d54f81be2e-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-53d14005-b183-4671-86ff-3e117e5ca80a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-53d14005-b183-4671-86ff-3e117e5ca80a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-quobyte-53d14005-b183-4671-86ff-3e117e5ca80a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-53d14005-b183-4671-86ff-3e117e5ca80a" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43f2ba8-4aad-4b2d-a67f-00d002e47778]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:37 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a Jul 16 12:57:37 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:37 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:37 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a Jul 16 12:57:37 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:37 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-53d14005-b183-4671-86ff-3e117e5ca80a" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-53d14005-b183-4671-86ff-3e117e5ca80a" released by "delete_volume" :: held 0.857s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Created reservations ['cf62cd19-5dab-4854-a005-2ab11a74133f', 'cf17eee8-44f2-4a33-a4b6-fa13c987c2cf', '95897b62-447c-460a-84af-f125bf991e79', '824bd509-5b84-4bc0-98af-318048b3b420'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:38 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:38 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-370e4f56-01bd-4906-9438-13c39a5dd8d8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-370e4f56-01bd-4906-9438-13c39a5dd8d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-quobyte-370e4f56-01bd-4906-9438-13c39a5dd8d8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-370e4f56-01bd-4906-9438-13c39a5dd8d8" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[64301c6c-0590-4491-ae7d-2f8229e18ca0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:38 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Deleted volume successfully. Jul 16 12:57:38 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 Jul 16 12:57:38 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a1130205-5b19-4b99-ac59-8855452d62b6 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-53d14005-b183-4671-86ff-3e117e5ca80a-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:38 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:38 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8 Jul 16 12:57:38 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:39 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-370e4f56-01bd-4906-9438-13c39a5dd8d8" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-370e4f56-01bd-4906-9438-13c39a5dd8d8" released by "delete_volume" :: held 0.842s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Created reservations ['e6d5bb51-617d-4756-84c9-cceced6a6950', '896d03b7-ea68-4760-b135-77a0e500b493', 'f99a2d88-d0d9-41e9-97f7-844ac0a604c0', '1c788639-1940-4943-a9ba-cbc9574ec334'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:39 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:39 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-275d53c1-6e72-40fb-a158-b9baca07955a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-275d53c1-6e72-40fb-a158-b9baca07955a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-quobyte-275d53c1-6e72-40fb-a158-b9baca07955a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-275d53c1-6e72-40fb-a158-b9baca07955a" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49c35e5-dfcc-4c90-9422-437313ba1143]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:39 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Deleted volume successfully. Jul 16 12:57:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d287bc41-0bef-4d13-9955-08bdfa3e02cf tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-370e4f56-01bd-4906-9438-13c39a5dd8d8-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:39 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a Jul 16 12:57:39 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:40 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:40 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a Jul 16 12:57:40 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:40 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-275d53c1-6e72-40fb-a158-b9baca07955a" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-275d53c1-6e72-40fb-a158-b9baca07955a" released by "delete_volume" :: held 0.868s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Created reservations ['1983241a-d846-4faa-a2e2-2d52d678ae88', '76420697-ca61-42b2-8373-060b203626c7', 'bbd07be0-ae33-4e33-8049-7e9e02bb6027', '1ff962ef-b053-4247-a3a8-d27610e914d2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-ae8f33bc-c3cf-42df-931d-38014efcde41-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:40 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:40 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-ae8f33bc-c3cf-42df-931d-38014efcde41-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "cinder-quobyte-ae8f33bc-c3cf-42df-931d-38014efcde41" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-ae8f33bc-c3cf-42df-931d-38014efcde41" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75a24c-df1e-48dc-b080-39475fdd14ff]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:41 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Deleted volume successfully. Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d999b0a-199d-4341-9a6d-0f4ccb382b0c tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-275d53c1-6e72-40fb-a158-b9baca07955a-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:41 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 Jul 16 12:57:41 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:41 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41" returned: 0 in 0.515s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:41 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41 Jul 16 12:57:41 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:41 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ae8f33bc-c3cf-42df-931d-38014efcde41" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-quobyte-ae8f33bc-c3cf-42df-931d-38014efcde41" released by "delete_volume" :: held 0.990s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Created reservations ['e7860fd2-66f4-4fd5-97a6-b50e3948c206', '2729bc9c-ad1e-4b34-bc7c-8658ecc15dde', '329c55fd-7ad1-4f2f-b9fb-66a044aa3f82', '28826e17-b7d2-41c6-8dc4-ed7071faf067'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:42 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:57:42 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:42 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:57:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Deleted volume successfully. Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76caa833-37d1-4387-a815-3a947fcbf079 tempest-CreateVolumesFromImageTest-80730461 None] Lock "cinder-ae8f33bc-c3cf-42df-931d-38014efcde41-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Flow 'volume_create_manager' (fb5e23bc-342a-45cb-a58b-77f7679c89a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a000c-c6e0-4147-8602-fbd0f6264bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9a000c-c6e0-4147-8602-fbd0f6264bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-717967086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67452ff6-bbac-41fe-a522-f23720a29ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6096e283db0b40bf8fb3fa8e4dcc775a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:43Z,use_quota=True,user_id='c3eb66b845924d1faaae2da6e2f982b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eed6fc4-79ad-4aec-b096-8c699638f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eed6fc4-79ad-4aec-b096-8c699638f80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a10355-62d4-4890-84b2-b6ebe50c21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a10355-62d4-4890-84b2-b6ebe50c21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67452ff6-bbac-41fe-a522-f23720a29ca0', 'volume_name': 'volume-67452ff6-bbac-41fe-a522-f23720a29ca0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f990f432-3fe5-4825-9833-c1e44a81cf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f990f432-3fe5-4825-9833-c1e44a81cf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd01f4-332e-4fdc-8299-7517487d45f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Volume 67452ff6-bbac-41fe-a522-f23720a29ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67452ff6-bbac-41fe-a522-f23720a29ca0', 'volume_size': 1} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-717967086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67452ff6-bbac-41fe-a522-f23720a29ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6096e283db0b40bf8fb3fa8e4dcc775a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:43Z,use_quota=True,user_id='c3eb66b845924d1faaae2da6e2f982b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Creating volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:42 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 1073741824 Jul 16 12:57:42 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:43 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 1073741824" returned: 0 in 0.556s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:43 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 Jul 16 12:57:43 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:43 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd01f4-332e-4fdc-8299-7517487d45f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67452ff6-bbac-41fe-a522-f23720a29ca0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a7968-83d5-4bd0-80a3-a987a37ea519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Volume volume-67452ff6-bbac-41fe-a522-f23720a29ca0 (67452ff6-bbac-41fe-a522-f23720a29ca0): created successfully Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1a7968-83d5-4bd0-80a3-a987a37ea519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Flow 'volume_create_manager' (fb5e23bc-342a-45cb-a58b-77f7679c89a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-06fe6160-7219-41af-9fd1-a7ada6a1840f tempest-SnapshotsActionsTest-1974030482 None] Created volume successfully. Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Creating offline snapshot 4aae43d5-8885-4b04-a2e0-c79fb9a014f3 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d4b9d8-50e8-402d-be6d-ab144d2b532f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:45 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 Jul 16 12:57:45 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:45 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Flow 'volume_create_manager' (26b596fc-f53f-43cb-bccd-469725cc6480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efebf846-963c-4abc-af6b-74687c6e3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0" returned: 0 in 0.562s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:45 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 1G Jul 16 12:57:45 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efebf846-963c-4abc-af6b-74687c6e3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-914405115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0c4f60-96da-42a9-8b46-45ade8387038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5a6557f474a6ebc31ea35bd9ca926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:46Z,use_quota=True,user_id='73a263c28af1482ebe099772283c3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5123aeab-4591-4b28-a10e-1ff5c370abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5123aeab-4591-4b28-a10e-1ff5c370abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2f51f5-75eb-48b7-b55d-4ca7e94ce54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2f51f5-75eb-48b7-b55d-4ca7e94ce54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0c4f60-96da-42a9-8b46-45ade8387038', 'volume_name': 'volume-0a0c4f60-96da-42a9-8b46-45ade8387038', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a033a3e8-d3ef-4d11-8988-91785bc83016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a033a3e8-d3ef-4d11-8988-91785bc83016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f98ce-d85b-44c0-9a36-d2e34f975ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:45 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Volume 0a0c4f60-96da-42a9-8b46-45ade8387038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0c4f60-96da-42a9-8b46-45ade8387038', 'volume_size': 1} Jul 16 12:57:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:46 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 1G" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:46 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:57:46 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:46 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 is being set with open permissions: ugo+rw Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:46 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:57:46 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:46 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:46 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info Jul 16 12:57:46 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (4ef4baf3-16ef-49f3-add4-55cfd628972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1c0429-cb13-4213-8e46-3bb65394ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1c0429-cb13-4213-8e46-3bb65394ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-380536866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3765b-15da-475f-8ac6-984b993907f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:47Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba85941-57a1-4073-9644-fe1fd5034e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba85941-57a1-4073-9644-fe1fd5034e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d5c4f-b5c8-4cd5-be21-988c4206d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d5c4f-b5c8-4cd5-be21-988c4206d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e3765b-15da-475f-8ac6-984b993907f5', 'volume_name': 'volume-96e3765b-15da-475f-8ac6-984b993907f5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cc8770-84de-456b-bbe8-e9b87f548968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cc8770-84de-456b-bbe8-e9b87f548968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500521e8-8a80-4259-94b9-2c7064efb503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Volume 96e3765b-15da-475f-8ac6-984b993907f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e3765b-15da-475f-8ac6-984b993907f5', 'volume_size': 1} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:47 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:47 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info is being set with open permissions: ugo+rw Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:47 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info Jul 16 12:57:47 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Flow 'volume_create_manager' (4a5679f8-63a7-496d-af0e-6510ab707ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a1aaf-57d7-46d5-97d9-e2f3d425a0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5a1aaf-57d7-46d5-97d9-e2f3d425a0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1351011870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa52997-8211-4649-a014-669d4bc80446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c349da9e9f04ca087faec9cdb09ae86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:47Z,use_quota=True,user_id='697a4d30ff694b47a75aa0dbc73ae4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222bad4d-7ecf-47b7-b108-ea166aed76fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222bad4d-7ecf-47b7-b108-ea166aed76fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cbfb5a-6401-4875-8a3e-3878ff0fff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88cbfb5a-6401-4875-8a3e-3878ff0fff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa52997-8211-4649-a014-669d4bc80446', 'volume_name': 'volume-dfa52997-8211-4649-a014-669d4bc80446', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d9e148-224e-400e-8321-b41f7bb783ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d9e148-224e-400e-8321-b41f7bb783ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42893b3f-b2a1-49c8-b0d6-f64753f5d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Volume dfa52997-8211-4649-a014-669d4bc80446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa52997-8211-4649-a014-669d4bc80446', 'volume_size': 1} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.info" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.384s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-914405115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0c4f60-96da-42a9-8b46-45ade8387038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5a6557f474a6ebc31ea35bd9ca926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:46Z,use_quota=True,user_id='73a263c28af1482ebe099772283c3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Creating volume 0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:47 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 1073741824 Jul 16 12:57:47 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-71e2c03c-be3b-4f6c-8bfb-ce9ddaa3eb31 tempest-SnapshotsActionsTest-1974030482 None] Create snapshot completed successfully Jul 16 12:57:47 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 1073741824" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:48 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:57:48 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:48 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-380536866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3765b-15da-475f-8ac6-984b993907f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e35d06320f084712a88bcb5c768db34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:47Z,use_quota=True,user_id='d8fa64166cce4928a13351bef2598b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Creating volume 96e3765b-15da-475f-8ac6-984b993907f5 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:48 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95f98ce-d85b-44c0-9a36-d2e34f975ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0c4f60-96da-42a9-8b46-45ade8387038', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:48 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 1073741824 Jul 16 12:57:48 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeadc77-ef84-4e55-805c-9547feebb0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Volume volume-0a0c4f60-96da-42a9-8b46-45ade8387038 (0a0c4f60-96da-42a9-8b46-45ade8387038): created successfully Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbeadc77-ef84-4e55-805c-9547feebb0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Flow 'volume_create_manager' (26b596fc-f53f-43cb-bccd-469725cc6480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7fe31dae-eaa2-4322-a12f-36474d8039ab tempest-VolumesActionsTest-1000244981 None] Created volume successfully. Jul 16 12:57:48 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 1073741824" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:48 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 Jul 16 12:57:48 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:49 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1351011870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa52997-8211-4649-a014-669d4bc80446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c349da9e9f04ca087faec9cdb09ae86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:47Z,use_quota=True,user_id='697a4d30ff694b47a75aa0dbc73ae4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Creating volume dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500521e8-8a80-4259-94b9-2c7064efb503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e3765b-15da-475f-8ac6-984b993907f5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:49 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 1073741824 Jul 16 12:57:49 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9485e60c-e13b-4f3f-a8e5-a446139079da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Volume volume-96e3765b-15da-475f-8ac6-984b993907f5 (96e3765b-15da-475f-8ac6-984b993907f5): created successfully Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9485e60c-e13b-4f3f-a8e5-a446139079da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Flow 'volume_create_manager' (4ef4baf3-16ef-49f3-add4-55cfd628972d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8f24dffb-5a7a-4ac5-a417-3da76c1ac7e4 tempest-AttachVolumeNegativeTest-2043106783 None] Created volume successfully. Jul 16 12:57:49 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 1073741824" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:49 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:57:49 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:49 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.031s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42893b3f-b2a1-49c8-b0d6-f64753f5d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa52997-8211-4649-a014-669d4bc80446', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9b806-32bc-48e1-a46e-5b2bb390c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Creating offline snapshot 0fbf6412-33db-4c55-898d-aed516b882ba of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d287d3c-16a5-41ae-b62c-fbc630806092]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Volume volume-dfa52997-8211-4649-a014-669d4bc80446 (dfa52997-8211-4649-a014-669d4bc80446): created successfully Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9b806-32bc-48e1-a46e-5b2bb390c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Flow 'volume_create_manager' (4a5679f8-63a7-496d-af0e-6510ab707ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6da1738a-9a77-4066-b0a7-c919f4ed283a tempest-VolumeDependencyTests-369140809 None] Created volume successfully. Jul 16 12:57:50 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:57:50 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:50 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.441s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:50 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba 1G Jul 16 12:57:50 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:51 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba 1G" returned: 0 in 0.694s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:51 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba Jul 16 12:57:51 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f574660d-9f6b-4f68-ba85-6f0e42c5023d req-133ecb77-dae6-4e5d-9c54-4b9901c7c4c0 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:51 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:51 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba is being set with open permissions: ugo+rw Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:51 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba Jul 16 12:57:51 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:51 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.811s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Creating offline snapshot b4054297-9748-4147-b3a8-2f85e9958488 of volume dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:57:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1d3de4d6-f4a6-4162-a653-97895fc47cc4 tempest-SnapshotsActionsTest-1974030482 None] Create snapshot completed successfully Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cb41e5-c032-4d96-ba7d-266ff8162f5a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:51 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:57:51 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-0fbf6412-33db-4c55-898d-aed516b882ba-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-0fbf6412-33db-4c55-898d-aed516b882ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-0fbf6412-33db-4c55-898d-aed516b882ba" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-0fbf6412-33db-4c55-898d-aed516b882ba" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Deleting offline snapshot 0fbf6412-33db-4c55-898d-aed516b882ba of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] snapshot_file for this snap is: volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5349bc-6ac5-45c2-8c8c-9125f6adf28b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:52 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.509s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:52 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 1G Jul 16 12:57:52 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:52 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba Jul 16 12:57:52 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:52 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a569c715-28a0-4f8d-917d-8e85bb2736e2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:52 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 1G" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfa52997-8211-4649-a014-669d4bc80446 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:52 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfa52997-8211-4649-a014-669d4bc80446 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:57:52 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:52 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:57:52 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:53 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfa52997-8211-4649-a014-669d4bc80446 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 is being set with open permissions: ugo+rw Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:53 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.442s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:53 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:57:53 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:53 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba Jul 16 12:57:53 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:53 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:53 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info Jul 16 12:57:53 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:53 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba" returned: 0 in 0.511s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:53 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba Jul 16 12:57:53 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:53 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info is being set with open permissions: ugo+rw Jul 16 12:57:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:54 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info Jul 16 12:57:54 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:54 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.0fbf6412-33db-4c55-898d-aed516b882ba" returned: 0 in 0.503s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-0fbf6412-33db-4c55-898d-aed516b882ba" released by "_delete_snapshot" :: held 2.036s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_snapshot" :: held 2.092s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Created reservations ['6c3135bb-ae68-4601-b4d6-94f948c53658', '8548b3b8-ab54-44d4-8cc6-2cb4ef1dbda8', '02a98cbe-7a36-48f0-b778-2a2f68c18fa3', '3a5896ae-2bcb-4e4b-b318-71c39feb3888'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:57:54 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.info" returned: 0 in 0.604s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.860s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f574660d-9f6b-4f68-ba85-6f0e42c5023d req-133ecb77-dae6-4e5d-9c54-4b9901c7c4c0 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.449s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Delete snapshot completed successfully. Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50578371-14f0-402f-b65c-95e973a3573b tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-0fbf6412-33db-4c55-898d-aed516b882ba-delete_snapshot" released by "delete_snapshot" :: held 2.601s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef0001b8-cd7b-47cf-ba75-9e087627f47a tempest-VolumeDependencyTests-369140809 None] Create snapshot completed successfully Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f574660d-9f6b-4f68-ba85-6f0e42c5023d req-133ecb77-dae6-4e5d-9c54-4b9901c7c4c0 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.230s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-f574660d-9f6b-4f68-ba85-6f0e42c5023d req-133ecb77-dae6-4e5d-9c54-4b9901c7c4c0 tempest-AttachVolumeNegativeTest-2043106783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-96e3765b-15da-475f-8ac6-984b993907f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2194069d-70ec-4e3b-8018-f0b6f21665cd', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 12:57:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-f574660d-9f6b-4f68-ba85-6f0e42c5023d req-133ecb77-dae6-4e5d-9c54-4b9901c7c4c0 tempest-AttachVolumeNegativeTest-2043106783 None] attachment_update completed successfully. Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Creating offline snapshot fca88325-866b-4211-a05e-d748c59c78e4 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80bf29-7a7d-4d89-a415-7dd5c8700266]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9cd2e1f-1484-435e-bbed-d1a1557b6816 tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Flow 'volume_create_manager' (ca79df8e-c616-44b2-959b-45817ff59638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9910d3-91be-42fe-b4c7-211637504011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9cd2e1f-1484-435e-bbed-d1a1557b6816 tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" acquired by "attach_volume" :: waited 0.071s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9910d3-91be-42fe-b4c7-211637504011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-185532297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6b35af-9fe2-4b7d-bb05-69918147a6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c349da9e9f04ca087faec9cdb09ae86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4054297-9748-4147-b3a8-2f85e9958488,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:57:56Z,use_quota=True,user_id='697a4d30ff694b47a75aa0dbc73ae4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba533f58-cfbf-4cdd-9979-9249c54b2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba533f58-cfbf-4cdd-9979-9249c54b2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83ab554-4d93-49c6-a9c2-fbaf741c709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83ab554-4d93-49c6-a9c2-fbaf741c709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d6b35af-9fe2-4b7d-bb05-69918147a6bd', 'volume_name': 'volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd', 'volume_size': 1, 'snapshot_id': 'b4054297-9748-4147-b3a8-2f85e9958488'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:56 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918d17e4-58e7-4fb2-a5dd-dd1a9bb0e05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:56 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918d17e4-58e7-4fb2-a5dd-dd1a9bb0e05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e7502-126d-457d-b300-87dff58669e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:57:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Volume 4d6b35af-9fe2-4b7d-bb05-69918147a6bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd', 'volume_size': 1, 'snapshot_id': 'b4054297-9748-4147-b3a8-2f85e9958488'} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9cd2e1f-1484-435e-bbed-d1a1557b6816 tempest-VolumesActionsTest-1000244981 None] Attaching volume 0a0c4f60-96da-42a9-8b46-45ade8387038 to instance 9b1df6fd-80c2-4ca2-9bf8-f8284eafe94f at mountpoint /dev/vdb on host None. Jul 16 12:57:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9cd2e1f-1484-435e-bbed-d1a1557b6816 tempest-VolumesActionsTest-1000244981 None] Attach volume completed successfully. Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9cd2e1f-1484-435e-bbed-d1a1557b6816 tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" released by "attach_volume" :: held 0.140s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afb6f8aa-518c-4d80-be94-6bc64af4d646 tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afb6f8aa-518c-4d80-be94-6bc64af4d646 tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afb6f8aa-518c-4d80-be94-6bc64af4d646 tempest-VolumesActionsTest-1000244981 None] Detaching volume 0a0c4f60-96da-42a9-8b46-45ade8387038 from instance 9b1df6fd-80c2-4ca2-9bf8-f8284eafe94f. Jul 16 12:57:57 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.469s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:57 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 1G Jul 16 12:57:57 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afb6f8aa-518c-4d80-be94-6bc64af4d646 tempest-VolumesActionsTest-1000244981 None] Detach volume completed successfully. Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afb6f8aa-518c-4d80-be94-6bc64af4d646 tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:57:57 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 1G" returned: 0 in 0.680s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:57 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 Jul 16 12:57:57 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:58 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4" returned: 0 in 0.533s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:58 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 is being set with open permissions: ugo+rw Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:58 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 Jul 16 12:57:58 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=156,cinder:INSERT=46,cinder:UPDATE=174,cinder:DELETE=12 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=175,cinder:SELECT=172,cinder:INSERT=48,cinder:DELETE=13 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:57:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bd0d9061-1646-4a70-ab9a-68f2c0773206 req-70a69ec5-f6db-42b8-b002-7897dfa807b2 tempest-AttachVolumeNegativeTest-2043106783 None] Terminate volume connection completed successfully. Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bd0d9061-1646-4a70-ab9a-68f2c0773206 req-70a69ec5-f6db-42b8-b002-7897dfa807b2 tempest-AttachVolumeNegativeTest-2043106783 None] Deleting attachment 2194069d-70ec-4e3b-8018-f0b6f21665cd. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 12:57:58 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4" returned: 0 in 0.345s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.905s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Creating volume 4d6b35af-9fe2-4b7d-bb05-69918147a6bd from snapshot b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] snapshot: b4054297-9748-4147-b3a8-2f85e9958488, volume: 4d6b35af-9fe2-4b7d-bb05-69918147a6bd, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:57:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-32f311fa-2e07-403b-8841-1cdd48d42da0 tempest-SnapshotsActionsTest-1974030482 None] Create snapshot completed successfully Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e951783-c50d-4623-ba43-9a0eda862512]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:58 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:57:58 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:59 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfa52997-8211-4649-a014-669d4bc80446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22b3477-98ca-4778-b191-4b5c1edcb6ac]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:59 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:57:59 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-fca88325-866b-4211-a05e-d748c59c78e4-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-fca88325-866b-4211-a05e-d748c59c78e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-fca88325-866b-4211-a05e-d748c59c78e4" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-fca88325-866b-4211-a05e-d748c59c78e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Deleting offline snapshot fca88325-866b-4211-a05e-d748c59c78e4 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] snapshot_file for this snap is: volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d66a4-48a9-4a30-8682-5c5aaef7a955]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:59 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:57:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:57:59 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 Jul 16 12:57:59 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:57:59 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd Jul 16 12:57:59 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:00 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4" returned: 0 in 0.657s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1309af-d679-47eb-b213-d28b245094ec]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:00 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:00 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:01 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 1.101s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:01 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 Jul 16 12:58:01 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:02 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4" returned: 0 in 1.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:02 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4 Jul 16 12:58:02 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:03 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.fca88325-866b-4211-a05e-d748c59c78e4" returned: 0 in 0.811s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-fca88325-866b-4211-a05e-d748c59c78e4" released by "_delete_snapshot" :: held 4.036s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_snapshot" :: held 4.066s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:03 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Created reservations ['c6ea282e-6a6b-40d0-82ed-8b8fb76c0d19', '32e0b47f-fad6-407e-9dc7-946eddd93acf', 'ecdb2dd0-a3a6-49c6-9a5c-57ef6adadf81', '91e2e60f-8872-4cba-b2ab-5609d22839f0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Delete snapshot completed successfully. Jul 16 12:58:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb7e5bd2-a0f5-4fdf-a93b-1f4fe5b39c29 tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-fca88325-866b-4211-a05e-d748c59c78e4-delete_snapshot" released by "delete_snapshot" :: held 4.536s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:06 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" returned: 0 in 6.668s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed1c00-8252-46e6-a21d-02cbc855b266]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:06 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:58:06 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:07 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.715s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:58:07 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Converted 1024.00 MB image at 153.55 MB/s Jul 16 12:58:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd is being set with open permissions: ugo+rw Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:07 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd Jul 16 12:58:07 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:07 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" released by "_copy_volume_from_snapshot" :: held 8.861s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" released by "_create_volume_from_snapshot" :: held 8.908s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.944s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.390s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Creating offline snapshot 024213a7-489b-4c02-a866-955aa75c4819 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540e7502-126d-457d-b300-87dff58669e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd', 'volume_size': 1, 'snapshot_id': 'b4054297-9748-4147-b3a8-2f85e9958488'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b5925c-70aa-4dca-a3fd-1e0eb047af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2e817-1f24-442c-a685-8a10e2f26a6e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Volume volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd (4d6b35af-9fe2-4b7d-bb05-69918147a6bd): created successfully Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b5925c-70aa-4dca-a3fd-1e0eb047af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Flow 'volume_create_manager' (ca79df8e-c616-44b2-959b-45817ff59638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d629b79a-5eab-4f42-b198-199ec0f2e629 tempest-VolumeDependencyTests-369140809 None] Created volume successfully. Jul 16 12:58:07 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:07 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:08 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:08 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 1G Jul 16 12:58:08 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-96e3765b-15da-475f-8ac6-984b993907f5-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-96e3765b-15da-475f-8ac6-984b993907f5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:08 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-quobyte-96e3765b-15da-475f-8ac6-984b993907f5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 1G" returned: 0 in 0.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-96e3765b-15da-475f-8ac6-984b993907f5" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:08 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 Jul 16 12:58:08 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-b4054297-9748-4147-b3a8-2f85e9958488-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef5aec-4337-44be-b1c1-c7e70d5ce53f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-b4054297-9748-4147-b3a8-2f85e9958488-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Deleting offline snapshot b4054297-9748-4147-b3a8-2f85e9958488 of volume dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] snapshot_file for this snap is: volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fb8ea1-cdac-4863-afa8-526fbe1dce8b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:08 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:08 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:08 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 Jul 16 12:58:08 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:08 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:58:08 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:09 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819" returned: 0 in 0.413s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 is being set with open permissions: ugo+rw Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:09 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 Jul 16 12:58:09 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:09 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:58:09 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:09 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.469s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfa52997-8211-4649-a014-669d4bc80446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:09 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5 Jul 16 12:58:09 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e0af9c-8e5a-4b28-9a7a-860e454e8c8d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:09 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:09 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:58:09 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-662867d3-4e17-4571-9105-bf8561f01469 tempest-SnapshotsActionsTest-1974030482 None] Create snapshot completed successfully Jul 16 12:58:09 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-96e3765b-15da-475f-8ac6-984b993907f5" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-96e3765b-15da-475f-8ac6-984b993907f5" released by "delete_volume" :: held 0.947s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Created reservations ['79fb7a4a-f87b-4b6f-bd6f-02520786eeac', '155128a9-bb54-4a1f-843b-dabc147dd564', '4e0fda87-d140-4830-823a-75972f3cd684', '23b6d030-3972-4311-9891-69346afc3f87'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:09 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:09 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:09 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.564s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:09 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:58:09 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:10 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Deleted volume successfully. Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46b23fd0-2edd-4e59-9747-4d243ed4bd69 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-96e3765b-15da-475f-8ac6-984b993907f5-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-024213a7-489b-4c02-a866-955aa75c4819-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:10 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-024213a7-489b-4c02-a866-955aa75c4819-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.838s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:10 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488 Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-024213a7-489b-4c02-a866-955aa75c4819" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:10 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-024213a7-489b-4c02-a866-955aa75c4819" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Deleting offline snapshot 024213a7-489b-4c02-a866-955aa75c4819 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] snapshot_file for this snap is: volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8a0939-ec2c-4b5b-bedc-4a8bcf5b84da]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-7bc53868-3133-4290-9efc-6d0a5a75ac2c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:11 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 Jul 16 12:58:11 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-7bc53868-3133-4290-9efc-6d0a5a75ac2c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-quobyte-7bc53868-3133-4290-9efc-6d0a5a75ac2c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:11 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-7bc53868-3133-4290-9efc-6d0a5a75ac2c" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446.b4054297-9748-4147-b3a8-2f85e9958488" returned: 0 in 0.637s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf0458-aa61-4a3b-94d8-c4da302605d1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-b4054297-9748-4147-b3a8-2f85e9958488" released by "_delete_snapshot" :: held 2.678s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" released by "delete_snapshot" :: held 2.711s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Created reservations ['dcf47727-99fc-4eeb-91f8-a6cae6821836', '1f6d3059-12bf-4cd5-b3a9-128f95949e9d', '6294148b-ce0d-4c3a-b1ea-96ce079a6963', '559ac707-8f59-4169-a15f-61b47c014070'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:11 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c Jul 16 12:58:11 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Delete snapshot completed successfully. Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9719716-b78e-4f48-8204-bd2f786667d3 tempest-VolumeDependencyTests-369140809 None] Lock "cinder-b4054297-9748-4147-b3a8-2f85e9958488-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:11 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819" returned: 0 in 0.761s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c44edff-9a24-4699-b822-cdf0a9c3f2ef]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:11 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:11 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-dfa52997-8211-4649-a014-669d4bc80446-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:12 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c" returned: 0 in 0.671s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-dfa52997-8211-4649-a014-669d4bc80446-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:12 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c Jul 16 12:58:12 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20a46e-d9ec-459b-8ce0-ea0802574073]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.607s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 Jul 16 12:58:12 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:12 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bc53868-3133-4290-9efc-6d0a5a75ac2c" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:12 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:58:12 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-7bc53868-3133-4290-9efc-6d0a5a75ac2c" released by "delete_volume" :: held 1.163s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Created reservations ['f2a3576e-768c-4e69-b093-659188dfc963', 'e467653c-4225-4ba9-b755-f4a58323f79f', 'a1f7e9b3-ccfe-4dd8-8260-ecd1abd9229a', 'fb9119f1-0f2e-409e-b63d-9322d3bf03c9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:12 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:12 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.649s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819" returned: 0 in 0.652s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:12 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446 Jul 16 12:58:12 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:13 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819 Jul 16 12:58:13 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5e397d1-fc8b-49f4-bdbd-ebb3ed37d6fb tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:13 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Deleted volume successfully. Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5e397d1-fc8b-49f4-bdbd-ebb3ed37d6fb tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" acquired by "attach_volume" :: waited 0.044s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd979214-e445-4ae9-a97f-4200a1742b8d tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-7bc53868-3133-4290-9efc-6d0a5a75ac2c-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d5e397d1-fc8b-49f4-bdbd-ebb3ed37d6fb tempest-VolumesActionsTest-1000244981 None] Attaching volume 0a0c4f60-96da-42a9-8b46-45ade8387038 to instance ffdb1ab3-513f-4b76-a3e0-bb7d08a1375b at mountpoint /dev/vdb on host None. Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d5e397d1-fc8b-49f4-bdbd-ebb3ed37d6fb tempest-VolumesActionsTest-1000244981 None] Attach volume completed successfully. Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5e397d1-fc8b-49f4-bdbd-ebb3ed37d6fb tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038" released by "attach_volume" :: held 0.150s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dfa52997-8211-4649-a014-669d4bc80446" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-dfa52997-8211-4649-a014-669d4bc80446" released by "delete_volume" :: held 1.123s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.024213a7-489b-4c02-a866-955aa75c4819" returned: 0 in 0.448s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-024213a7-489b-4c02-a866-955aa75c4819" released by "_delete_snapshot" :: held 2.636s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_snapshot" :: held 2.690s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Created reservations ['c18b8a3e-0ff8-4506-b18f-9c818e1fef25', '6dbe396f-a06d-4e1a-861b-b434a0c7e63e', 'f674e92f-3806-4aa3-821c-640ce09a6590', '16de9cb6-0fb2-4222-814f-80927915430e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70771630-d4b7-4e11-960d-fe0ebe1cfcbd tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70771630-d4b7-4e11-960d-fe0ebe1cfcbd tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70771630-d4b7-4e11-960d-fe0ebe1cfcbd tempest-VolumesActionsTest-1000244981 None] Detaching volume 0a0c4f60-96da-42a9-8b46-45ade8387038 from instance ffdb1ab3-513f-4b76-a3e0-bb7d08a1375b. Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70771630-d4b7-4e11-960d-fe0ebe1cfcbd tempest-VolumesActionsTest-1000244981 None] Detach volume completed successfully. Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70771630-d4b7-4e11-960d-fe0ebe1cfcbd tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-detach_volume" released by "detach_volume" :: held 0.183s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:13 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:13 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Created reservations ['23ff4205-4fde-4918-93c6-fd58db0ddb6d', '9410970f-ffe8-40fa-a915-fa595a554477', '77f6f31d-9e56-4e78-b615-1295818fa965', '188260ad-5f8f-4c32-8479-16a93b0487fd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-06600d5e-6a22-4e55-93ac-c7d7c2e799e1-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Delete snapshot completed successfully. Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-06600d5e-6a22-4e55-93ac-c7d7c2e799e1-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0567aa7-3db8-45ef-8933-17453e5931bb tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-024213a7-489b-4c02-a866-955aa75c4819-delete_snapshot" released by "delete_snapshot" :: held 3.338s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:14 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Deleted volume successfully. Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "cinder-quobyte-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b4093b7b-7fed-473d-be6f-417c64ea186a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-dfa52997-8211-4649-a014-669d4bc80446-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" acquired by "delete_volume" :: waited 0.057s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3355bff8-cdbf-4dc4-bfa0-a3bf4bc4a745]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-4d6b35af-9fe2-4b7d-bb05-69918147a6bd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:14 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 Jul 16 12:58:14 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-4d6b35af-9fe2-4b7d-bb05-69918147a6bd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Creating offline snapshot 8700bac1-1e20-4d8d-91af-4fd703339407 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" acquired by "delete_volume" :: waited 0.116s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[267abc23-983e-40a5-b7b6-87a6280c7c10]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[718581e4-8ff1-4a0a-8021-ff9ac505cfe3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:15 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" returned: 0 in 0.850s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:15 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:15 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:15 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1 Jul 16 12:58:15 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:15 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd Jul 16 12:58:15 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:15 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-quobyte-06600d5e-6a22-4e55-93ac-c7d7c2e799e1" released by "delete_volume" :: held 1.332s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:15 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.679s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Created reservations ['eee58858-932e-4956-94af-8f961fc4caa7', '08faa250-bb0e-4486-8022-b89271cb8116', '4055c1f4-1894-4e70-955b-d269b0077799', '394d2e6a-c715-41fc-9035-9da75c97a53f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:15 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 1G Jul 16 12:58:15 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:15 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" returned: 0 in 0.729s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:15 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd Jul 16 12:58:15 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:15 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:15 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:16 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-quobyte-4d6b35af-9fe2-4b7d-bb05-69918147a6bd" released by "delete_volume" :: held 1.300s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:16 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Deleted volume successfully. Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c843fd06-2436-4a12-95a7-d85f4335be91 tempest-AttachVolumeNegativeTest-2043106783 None] Lock "cinder-06600d5e-6a22-4e55-93ac-c7d7c2e799e1-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Created reservations ['9f966934-7cde-46ea-beff-838f50d97277', 'f7ccd551-db2c-440d-851a-015abc31c892', 'e9496fc6-710d-4a47-a646-b20bf033dd3c', '63a5622b-34eb-4758-ae91-1ec36473237d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:16 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 1G" returned: 0 in 0.731s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:16 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 Jul 16 12:58:16 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:16 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:16 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:16 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:16 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:16 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 is being set with open permissions: ugo+rw Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Deleted volume successfully. Jul 16 12:58:16 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 Jul 16 12:58:16 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ff65c86-7dd5-4681-8523-e19f5f84f31a tempest-VolumeDependencyTests-369140809 None] Lock "cinder-4d6b35af-9fe2-4b7d-bb05-69918147a6bd-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:17 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c3df19cb-4250-40e5-8eaa-21bf601f683e tempest-SnapshotsActionsTest-1974030482 None] Create snapshot completed successfully Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-8700bac1-1e20-4d8d-91af-4fd703339407-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-8700bac1-1e20-4d8d-91af-4fd703339407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Acquiring lock "cinder-quobyte-8700bac1-1e20-4d8d-91af-4fd703339407" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-8700bac1-1e20-4d8d-91af-4fd703339407" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Deleting offline snapshot 8700bac1-1e20-4d8d-91af-4fd703339407 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] snapshot_file for this snap is: volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[752322d6-6c60-43b9-b9fd-36da4a1ae843]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:18 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 Jul 16 12:58:18 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:18 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407" returned: 0 in 0.522s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924f95e-44a6-40a3-921a-ddaff15ce8c7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:18 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:18 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466c5f5-2059-4ad9-a4b7-6f7efbc065cd]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:19 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:19 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 Jul 16 12:58:19 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:19 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:19 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:19 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.481s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c073fc5-fa28-4440-a18e-128ecbd05453]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:19 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:19 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407 Jul 16 12:58:19 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:19 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:19 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:20 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.8700bac1-1e20-4d8d-91af-4fd703339407" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-8700bac1-1e20-4d8d-91af-4fd703339407" released by "_delete_snapshot" :: held 1.900s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_snapshot" :: held 1.936s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:20 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.9c00a079-9673-418a-bd37-5bbbde59c646ay9pxrwz.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:20 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.9c00a079-9673-418a-bd37-5bbbde59c646ay9pxrwz.img Jul 16 12:58:20 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Created reservations ['2eb0b082-d70f-44b7-beb9-8dfd54978edb', '6a327c4f-82f2-450c-b146-a5928eb28da4', '6f1dd3ca-b215-4178-963a-096a9f2c1b2d', '1bb295f6-0dd7-4aa7-b6b2-8a9fd0764954'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Delete snapshot completed successfully. Jul 16 12:58:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cea98dd-7c7b-4194-9843-3e60a3eac2cc tempest-SnapshotsActionsTest-577161942 None] Lock "cinder-8700bac1-1e20-4d8d-91af-4fd703339407-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "cinder-4aae43d5-8885-4b04-a2e0-c79fb9a014f3-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-4aae43d5-8885-4b04-a2e0-c79fb9a014f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "cinder-quobyte-4aae43d5-8885-4b04-a2e0-c79fb9a014f3" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-4aae43d5-8885-4b04-a2e0-c79fb9a014f3" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Deleting offline snapshot 4aae43d5-8885-4b04-a2e0-c79fb9a014f3 of volume 67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] snapshot_file for this snap is: volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3431bfb-1083-4d0b-b1a9-07c1f40ae7d9]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:23 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:23 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:58:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Flow 'volume_create_manager' (79cb1e7a-5b95-4b2f-8e98-cd65a66e55cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d4318c-b5b7-4181-9037-243c200d8e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d4318c-b5b7-4181-9037-243c200d8e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355550187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845b2480-cccb-4059-8707-12bebe7df5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1573229046f486cbe6549ee2b9ec2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:24Z,use_quota=True,user_id='b90c5125b20f4fcc8d5db0a14060f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db10d7b-244d-4f77-8e78-6854d1b9d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:24 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db10d7b-244d-4f77-8e78-6854d1b9d351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f6bd7-48f6-4088-b37c-f02a42ef96f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (345f6bd7-48f6-4088-b37c-f02a42ef96f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '845b2480-cccb-4059-8707-12bebe7df5a9', 'volume_name': 'volume-845b2480-cccb-4059-8707-12bebe7df5a9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f891189-5205-4af2-ba72-02320c3c69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f891189-5205-4af2-ba72-02320c3c69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70357f2-823a-40d8-976c-5f203186e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Volume 845b2480-cccb-4059-8707-12bebe7df5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-845b2480-cccb-4059-8707-12bebe7df5a9', 'volume_size': 1} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 1.204s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67452ff6-bbac-41fe-a522-f23720a29ca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb8a1a0-ef78-41aa-b313-c4e789c37502]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:24 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 Jul 16 12:58:24 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:25 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0" returned: 0 in 1.106s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:25 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:25 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:25 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:25 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.9c00a079-9673-418a-bd37-5bbbde59c646ay9pxrwz.img" returned: 0 in 5.803s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506c87a-87de-446a-80ec-f59f75615d04]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:25 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3 Jul 16 12:58:25 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:26 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:26 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:26 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0.4aae43d5-8885-4b04-a2e0-c79fb9a014f3" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-4aae43d5-8885-4b04-a2e0-c79fb9a014f3" released by "_delete_snapshot" :: held 3.450s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_snapshot" :: held 3.510s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Created reservations ['6a781813-b633-433c-a1c8-bd2914b207ba', '97e3c208-6b16-4e48-b7e5-2bad9ca14d90', 'dfa40616-97e9-46e1-919f-067ccefc277d', 'bdd1226a-ffed-42f0-8f09-0aa37413a90f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Delete snapshot completed successfully. Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-972b5e00-4b70-42b5-94cd-71d5b65910e8 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-4aae43d5-8885-4b04-a2e0-c79fb9a014f3-delete_snapshot" released by "delete_snapshot" :: held 3.704s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:26 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.573s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.9c00a079-9673-418a-bd37-5bbbde59c646ay9pxrwz.img {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:58:26 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Converted 1024.00 MB image at 176.41 MB/s Jul 16 12:58:26 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] 9c00a079-9673-418a-bd37-5bbbde59c646 was raw, no need to convert to raw {{(pid=87560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "cinder-67452ff6-bbac-41fe-a522-f23720a29ca0-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-67452ff6-bbac-41fe-a522-f23720a29ca0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[078bc3e8-81bc-41ed-8a92-49dc89aed910]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:27 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 Jul 16 12:58:27 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:27 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:27 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0 Jul 16 12:58:27 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:27 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-67452ff6-bbac-41fe-a522-f23720a29ca0" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-quobyte-67452ff6-bbac-41fe-a522-f23720a29ca0" released by "delete_volume" :: held 0.764s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Created reservations ['ffc6a79b-e8b2-4b25-bf4e-f9b9bf5b6812', 'fede6518-d2a3-47e6-9306-ef846ada5c7e', '9b914735-94ae-4d8c-b0ae-9dda7897fddf', 'dca61a59-deb6-46eb-9982-09951b6a8c9a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:28 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:28 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Flow 'volume_create_manager' (4aa2dffb-eada-4457-b165-6f058f706697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce03872e-c532-4a78-9a8a-c0a81d544d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce03872e-c532-4a78-9a8a-c0a81d544d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-597528908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b74f60-759a-4155-ad17-56504d5e9cec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='309373901dba472492bf9a3d9250d791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:28Z,use_quota=True,user_id='b71fcfca104f4bad8dd9019443c40b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8c5329-f4af-4426-9732-d5ca22e3f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:28 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8c5329-f4af-4426-9732-d5ca22e3f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc339049-f2cb-4730-88a3-4a1a70486b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc339049-f2cb-4730-88a3-4a1a70486b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b74f60-759a-4155-ad17-56504d5e9cec', 'volume_name': 'volume-e2b74f60-759a-4155-ad17-56504d5e9cec', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1673832e-9c20-4e0d-a302-d7074bf0bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1673832e-9c20-4e0d-a302-d7074bf0bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d9b719-f3b9-48ad-9fe0-04ae7f20f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Volume e2b74f60-759a-4155-ad17-56504d5e9cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b74f60-759a-4155-ad17-56504d5e9cec', 'volume_size': 1} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.319s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Deleted volume successfully. Jul 16 12:58:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c1495f3-f92c-42fc-a706-38c1fd5cb805 tempest-SnapshotsActionsTest-1974030482 None] Lock "cinder-67452ff6-bbac-41fe-a522-f23720a29ca0-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:38 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=81,cinder:INSERT=23,cinder:UPDATE=75,cinder:DELETE=4 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:58:38 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=93,cinder:SELECT=64,cinder:DELETE=6,cinder:INSERT=23 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Flow 'volume_create_manager' (a8933f23-2627-492e-b7c2-d46fa36108ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caaec3a-a979-44a8-a0f8-f2d310e96671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0caaec3a-a979-44a8-a0f8-f2d310e96671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-832694784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b41058d-53c6-47fc-8a0b-8427d895c6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c45d236ec64db584989f229941ac3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:42Z,use_quota=True,user_id='d25bb7e4f09845b2922e6698e18c0601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2008d6cb-3a8c-4c52-9143-d77c1ae6c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2008d6cb-3a8c-4c52-9143-d77c1ae6c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f501c1d-a65a-48e4-8f0e-fa3673ed9234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f501c1d-a65a-48e4-8f0e-fa3673ed9234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b41058d-53c6-47fc-8a0b-8427d895c6b3', 'volume_name': 'volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7928e7-5be9-40db-8d4f-2bbf6a844b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7928e7-5be9-40db-8d4f-2bbf6a844b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86d6459-cfcb-44c5-812d-5145f7170ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Volume 9b41058d-53c6-47fc-8a0b-8427d895c6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3', 'volume_size': 1} Jul 16 12:58:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.950s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Uploaded volume to glance image-id: 9c00a079-9673-418a-bd37-5bbbde59c646. {{(pid=87560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.966s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355550187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845b2480-cccb-4059-8707-12bebe7df5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1573229046f486cbe6549ee2b9ec2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:24Z,use_quota=True,user_id='b90c5125b20f4fcc8d5db0a14060f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Creating volume 845b2480-cccb-4059-8707-12bebe7df5a9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:58:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:47 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 1073741824 Jul 16 12:58:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7cb462a9-6ef2-47b6-9d3d-be45e2af5790 tempest-VolumesActionsTest-1000244981 None] Copy volume to image completed successfully. Jul 16 12:58:47 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:47 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 1073741824" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:47 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 Jul 16 12:58:47 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:47 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.302s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-597528908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b74f60-759a-4155-ad17-56504d5e9cec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='309373901dba472492bf9a3d9250d791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:28Z,use_quota=True,user_id='b71fcfca104f4bad8dd9019443c40b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Creating volume e2b74f60-759a-4155-ad17-56504d5e9cec {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:58:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70357f2-823a-40d8-976c-5f203186e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845b2480-cccb-4059-8707-12bebe7df5a9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:47 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec 1073741824 Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be33e29-bb74-48b7-b48c-35a02912625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:47 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Volume volume-845b2480-cccb-4059-8707-12bebe7df5a9 (845b2480-cccb-4059-8707-12bebe7df5a9): created successfully Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be33e29-bb74-48b7-b48c-35a02912625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Flow 'volume_create_manager' (79cb1e7a-5b95-4b2f-8e98-cd65a66e55cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7318b65c-51e7-45cc-8132-a33c20d3e1ce tempest-ProjectReaderTests-1361660744 None] Created volume successfully. Jul 16 12:58:48 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec 1073741824" returned: 0 in 0.479s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:48 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec Jul 16 12:58:48 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Acquiring lock "cinder-845b2480-cccb-4059-8707-12bebe7df5a9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "cinder-845b2480-cccb-4059-8707-12bebe7df5a9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Acquiring lock "cinder-quobyte-845b2480-cccb-4059-8707-12bebe7df5a9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "cinder-quobyte-845b2480-cccb-4059-8707-12bebe7df5a9" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5202348a-2eab-4793-843d-8bfd9a43c58a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:48 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-832694784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b41058d-53c6-47fc-8a0b-8427d895c6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77c45d236ec64db584989f229941ac3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:42Z,use_quota=True,user_id='d25bb7e4f09845b2922e6698e18c0601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Creating volume 9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:58:48 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:48 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 Jul 16 12:58:48 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:48 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 1073741824 Jul 16 12:58:48 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d9b719-f3b9-48ad-9fe0-04ae7f20f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b74f60-759a-4155-ad17-56504d5e9cec', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f07e4b-30d1-4ffe-9c05-6f862305ceb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Volume volume-e2b74f60-759a-4155-ad17-56504d5e9cec (e2b74f60-759a-4155-ad17-56504d5e9cec): created successfully Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f07e4b-30d1-4ffe-9c05-6f862305ceb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Flow 'volume_create_manager' (4aa2dffb-eada-4457-b165-6f058f706697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bb8e2898-0e71-4c26-aa3c-ff09a48d55b7 req-423153b6-20cf-4614-bd0b-8f6d75e176a8 tempest-VolumesGetTestJSON-192390296 None] Created volume successfully. Jul 16 12:58:48 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:48 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9 Jul 16 12:58:48 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:49 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 1073741824" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:49 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 Jul 16 12:58:49 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:49 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-845b2480-cccb-4059-8707-12bebe7df5a9" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "cinder-quobyte-845b2480-cccb-4059-8707-12bebe7df5a9" released by "delete_volume" :: held 0.680s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Created reservations ['822109d8-dff1-4fa3-8407-254f3cb6e6fd', '2cef8949-65d3-4a2e-9414-2e40a38cdeac', 'e1b9650c-4498-4b87-9577-769a4732ef32', 'e8aa26a4-d79d-41ec-8241-8926e2cbc751'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:49 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:49 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:49 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.884s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86d6459-cfcb-44c5-812d-5145f7170ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bbf75f-f823-49de-9eee-8f5dc52713b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd78fbb-c120-43fb-b87d-c3d28588dac4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Volume volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 (9b41058d-53c6-47fc-8a0b-8427d895c6b3): created successfully Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bbf75f-f823-49de-9eee-8f5dc52713b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Flow 'volume_create_manager' (a8933f23-2627-492e-b7c2-d46fa36108ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c99f5fc1-6a1f-4fbb-8a5d-7295a58cbc2e tempest-SnapshotMetadataTestJSON-609119894 None] Created volume successfully. Jul 16 12:58:49 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:49 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:49 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Deleted volume successfully. Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ed40d0f5-a3fa-4261-b873-73ff3bb219b3 tempest-ProjectReaderTests-1361660744 None] Lock "cinder-845b2480-cccb-4059-8707-12bebe7df5a9-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Acquiring lock "cinder-e2b74f60-759a-4155-ad17-56504d5e9cec-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:49 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "cinder-e2b74f60-759a-4155-ad17-56504d5e9cec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a59e5-64fe-4bd9-b3a6-d7d11113efbf]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Acquiring lock "cinder-quobyte-e2b74f60-759a-4155-ad17-56504d5e9cec" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "cinder-quobyte-e2b74f60-759a-4155-ad17-56504d5e9cec" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ee8cd-11e9-4f9e-90c5-45656780306e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:50 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:50 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:50 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec Jul 16 12:58:50 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Flow 'volume_create_manager' (91754cea-b0bd-41ce-bf4f-52dfb90a3b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd6eaf0-fe56-43fd-be13-d5db3451a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd6eaf0-fe56-43fd-be13-d5db3451a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200559327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acfa2d1-81e5-4477-842c-4d0f39b6a659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1573229046f486cbe6549ee2b9ec2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:50Z,use_quota=True,user_id='b90c5125b20f4fcc8d5db0a14060f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8386dd16-d670-46d1-928e-d6875b2f7a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8386dd16-d670-46d1-928e-d6875b2f7a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b56ca6-b5de-49f8-9afe-5e2e09812e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b56ca6-b5de-49f8-9afe-5e2e09812e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acfa2d1-81e5-4477-842c-4d0f39b6a659', 'volume_name': 'volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:50 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc67ff-b781-4f90-957f-d171e4b7e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdc67ff-b781-4f90-957f-d171e4b7e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff70c3c-fede-45ed-a4b9-a82326f4269a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:58:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Volume 5acfa2d1-81e5-4477-842c-4d0f39b6a659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659', 'volume_size': 1} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.511s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:50 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img Jul 16 12:58:50 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:50 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec" returned: 0 in 0.427s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:50 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec Jul 16 12:58:50 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:50 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e2b74f60-759a-4155-ad17-56504d5e9cec" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "cinder-quobyte-e2b74f60-759a-4155-ad17-56504d5e9cec" released by "delete_volume" :: held 0.746s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:50 devstack cinder-volume[87560]: DEBUG cinder.quota [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Created reservations ['565dff68-5181-40f2-b182-cec15b947886', '4c792035-0432-4bc2-a194-b285141c5bc3', '6a90e65d-11c7-4a54-9f73-dea036965ef9', '850cf180-8838-4423-a1a4-a2c75e98653e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:51 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:58:51 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:51 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.441s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG cinder.manager [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:58:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Deleted volume successfully. Jul 16 12:58:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-6f62dab8-5c74-45e9-b9a4-c3da2f5b8643 req-291e404b-4702-4ba9-bcf9-bbfdac49560c tempest-VolumesGetTestJSON-192390296 None] Lock "cinder-e2b74f60-759a-4155-ad17-56504d5e9cec-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:58:55 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img" returned: 0 in 4.757s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69316d4-c994-4d68-b19a-62d6627ae3ab]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:55 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:58:55 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:55 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.548s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:58:55 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Converted 1024.00 MB image at 215.23 MB/s Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] 3ac87b77-ff9f-4715-b84e-5abe20c337a0 was raw, converting to qcow2 {{(pid=87560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa49d5b-1149-4783-bc95-1a0dfadfadf8]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:55 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img Jul 16 12:58:55 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:56 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:56 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img Jul 16 12:58:56 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:56 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img" returned: 1 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:56 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4 Jul 16 12:58:56 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:56 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Image conversion details: src /opt/stack/data/cinder/conversion/0a0c4f60-96da-42a9-8b46-45ade8387038.temp_image.3ac87b77-ff9f-4715-b84e-5abe20c337a0zza3xtit.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:58:56 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0354f372-7019-45d1-addf-c38c8c7a9486]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:56 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4 Jul 16 12:58:56 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:57 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w3x5jmi4" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.217s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Uploaded volume to glance image-id: 3ac87b77-ff9f-4715-b84e-5abe20c337a0. {{(pid=87560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.252s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Creating offline snapshot 3e5d9e9d-01b5-49ec-833b-1092787604bf of volume 9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:58:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e84d6263-a33b-47fa-a84a-1504b477a3b8 tempest-VolumesActionsTest-1000244981 None] Copy volume to image completed successfully. Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fee1e-5e34-430d-a66a-c66c41379478]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:58 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 Jul 16 12:58:58 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:59 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:59 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf 1G Jul 16 12:58:59 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:59 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf 1G" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:59 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf Jul 16 12:58:59 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:59 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:58:59 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf is being set with open permissions: ugo+rw Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:59 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf Jul 16 12:58:59 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Acquiring lock "cinder-quobyte-0a0c4f60-96da-42a9-8b46-45ade8387038" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "cinder-quobyte-0a0c4f60-96da-42a9-8b46-45ade8387038" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[732fc3a7-f8c7-49e1-ba16-4fa65dbc3186]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:58:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:59:00 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:00 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info Jul 16 12:59:00 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:00 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038 Jul 16 12:59:00 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:00 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:00 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info is being set with open permissions: ugo+rw Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info Jul 16 12:59:00 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:00 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0a0c4f60-96da-42a9-8b46-45ade8387038" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "cinder-quobyte-0a0c4f60-96da-42a9-8b46-45ade8387038" released by "delete_volume" :: held 0.747s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Created reservations ['31688275-b1e3-405e-885f-33a775e84c46', 'c91bac91-838c-430b-9558-4d94d0540f7f', '28918fde-96b4-4364-8c43-38c1bdc79938', '32d6b6fd-eafb-4eeb-83d0-2dc9ee08cc43'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:00 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.info" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.144s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.312s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200559327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acfa2d1-81e5-4477-842c-4d0f39b6a659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1573229046f486cbe6549ee2b9ec2d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:58:50Z,use_quota=True,user_id='b90c5125b20f4fcc8d5db0a14060f3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Creating volume 5acfa2d1-81e5-4477-842c-4d0f39b6a659 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 1073741824 Jul 16 12:59:00 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5b82f4fb-41b8-4d11-addd-741d2385a98c tempest-SnapshotMetadataTestJSON-609119894 None] Create snapshot completed successfully Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:00 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:00 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:01 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Deleted volume successfully. Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7a93505f-81c4-4def-ab6a-ea2c2e9db61d tempest-VolumesActionsTest-1000244981 None] Lock "cinder-0a0c4f60-96da-42a9-8b46-45ade8387038-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:01 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 1073741824" returned: 0 in 0.571s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:01 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 Jul 16 12:59:01 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:01 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff70c3c-fede-45ed-a4b9-a82326f4269a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141cdbfb-5205-426e-a4e3-90100cfd3b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Volume volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 (5acfa2d1-81e5-4477-842c-4d0f39b6a659): created successfully Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141cdbfb-5205-426e-a4e3-90100cfd3b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Flow 'volume_create_manager' (91754cea-b0bd-41ce-bf4f-52dfb90a3b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1afa2084-875e-47b9-98f0-d9326b365fda tempest-ProjectReaderTests-1361660744 None] Created volume successfully. Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Acquiring lock "cinder-5acfa2d1-81e5-4477-842c-4d0f39b6a659-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "cinder-5acfa2d1-81e5-4477-842c-4d0f39b6a659-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Acquiring lock "cinder-quobyte-5acfa2d1-81e5-4477-842c-4d0f39b6a659" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "cinder-quobyte-5acfa2d1-81e5-4477-842c-4d0f39b6a659" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2393e6-1d1b-450d-bd1c-932bc6745b79]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:02 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 Jul 16 12:59:02 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "cinder-3e5d9e9d-01b5-49ec-833b-1092787604bf-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-3e5d9e9d-01b5-49ec-833b-1092787604bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "cinder-quobyte-3e5d9e9d-01b5-49ec-833b-1092787604bf" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-3e5d9e9d-01b5-49ec-833b-1092787604bf" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Deleting offline snapshot 3e5d9e9d-01b5-49ec-833b-1092787604bf of volume 9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] snapshot_file for this snap is: volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23d8f8-b4c3-4bee-9608-6aba6af6581b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:03 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659" returned: 0 in 0.561s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:03 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659 Jul 16 12:59:03 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:03 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf Jul 16 12:59:03 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:03 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5acfa2d1-81e5-4477-842c-4d0f39b6a659" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "cinder-quobyte-5acfa2d1-81e5-4477-842c-4d0f39b6a659" released by "delete_volume" :: held 0.921s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:03 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b2ce5-8f07-41cf-add2-4bdf96151c34]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Created reservations ['85c36a26-ec59-417d-826b-7787dba01af0', '9582395e-7c06-4e4a-9272-ef1ff8c6911b', '7fcefd06-5b77-4048-a4bd-a57519d45645', 'b6397504-3ad0-4b6b-9007-13095ede0b8b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:03 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 Jul 16 12:59:03 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:03 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:03 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:03 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:03 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Deleted volume successfully. Jul 16 12:59:03 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf Jul 16 12:59:03 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2ee5dbf9-2ae5-4bb5-871d-a93cc3975c6a tempest-ProjectReaderTests-1361660744 None] Lock "cinder-5acfa2d1-81e5-4477-842c-4d0f39b6a659-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:04 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:04 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf Jul 16 12:59:04 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:04 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3.3e5d9e9d-01b5-49ec-833b-1092787604bf" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-3e5d9e9d-01b5-49ec-833b-1092787604bf" released by "_delete_snapshot" :: held 1.886s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" released by "delete_snapshot" :: held 1.927s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Created reservations ['d960b514-45a7-4d83-b7e8-44991b535591', '991bb46a-e3a1-4252-935c-b3c7bc41e6a6', '9c688612-9500-42a7-a7c4-2391c1a99450', '4f65cdb1-a106-48c0-84da-8f35abfbc4de'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Delete snapshot completed successfully. Jul 16 12:59:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dca9b02-7376-4e4b-8502-b6c95c09d811 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-3e5d9e9d-01b5-49ec-833b-1092787604bf-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "cinder-9b41058d-53c6-47fc-8a0b-8427d895c6b3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-9b41058d-53c6-47fc-8a0b-8427d895c6b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684f990-ecf7-4246-a8b6-4888c6b29d0f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:05 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 Jul 16 12:59:05 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:05 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3" returned: 0 in 0.537s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:05 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3 Jul 16 12:59:05 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:06 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9b41058d-53c6-47fc-8a0b-8427d895c6b3" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-quobyte-9b41058d-53c6-47fc-8a0b-8427d895c6b3" released by "delete_volume" :: held 0.908s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Created reservations ['d47bc997-5e0c-4e4e-8647-80cf48d7ad1f', 'e2854a21-6dd0-43a9-88c8-3ba4e384204b', 'ce596fbe-73ea-4ce6-ba21-e38383a0f631', 'a5071e4a-9a30-4ca1-8529-7397279fd130'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:06 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:06 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:06 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Deleted volume successfully. Jul 16 12:59:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7675a911-66c7-47cf-bcb2-619cdada12c4 tempest-SnapshotMetadataTestJSON-609119894 None] Lock "cinder-9b41058d-53c6-47fc-8a0b-8427d895c6b3-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:08 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:08 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:09 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 12:59:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9e600fb7-75a2-4325-9589-cc83e133e2d3 tempest-GroupsTest-1103168844 None] Group tempest-Group1-599236655: creating Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Flow 'volume_create_manager' (9f7eb84f-4fdb-43e5-b328-eb1c0942c54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eae91a8-9256-4d7a-8d13-b7da67406856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eae91a8-9256-4d7a-8d13-b7da67406856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-499669521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2460fe6-aba1-4f38-8a2c-10feba374bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea8facef068466ebf75bbf556bbd2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:10Z,use_quota=True,user_id='88c5e322567e42b9862daa8033121c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3ac327-9ff1-4a86-a8f7-a7d325434589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3ac327-9ff1-4a86-a8f7-a7d325434589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f26b02-cbff-429f-be28-6e5eab06b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f26b02-cbff-429f-be28-6e5eab06b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2460fe6-aba1-4f38-8a2c-10feba374bfc', 'volume_name': 'volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb94764-0dcd-4836-8d28-1ad1959ca07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb94764-0dcd-4836-8d28-1ad1959ca07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2eac03-046b-4551-8f0a-8aa60328b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Volume d2460fe6-aba1-4f38-8a2c-10feba374bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc', 'volume_size': 1} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-499669521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2460fe6-aba1-4f38-8a2c-10feba374bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea8facef068466ebf75bbf556bbd2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:10Z,use_quota=True,user_id='88c5e322567e42b9862daa8033121c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Creating volume d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9e600fb7-75a2-4325-9589-cc83e133e2d3 tempest-GroupsTest-1103168844 None] Group tempest-Group1-599236655: created successfully Jul 16 12:59:09 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc 1073741824 Jul 16 12:59:09 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9e600fb7-75a2-4325-9589-cc83e133e2d3 tempest-GroupsTest-1103168844 None] Create group completed successfully. Jul 16 12:59:10 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc 1073741824" returned: 0 in 0.522s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:10 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:10 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30bb2d9a-3c16-464a-a74a-32086154a713 tempest-GroupsTest-1103168844 None] Group tempest-Group2-2003922038: creating Jul 16 12:59:10 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2eac03-046b-4551-8f0a-8aa60328b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8b315a-88f8-4769-8050-619d4eca6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30bb2d9a-3c16-464a-a74a-32086154a713 tempest-GroupsTest-1103168844 None] Group tempest-Group2-2003922038: created successfully Jul 16 12:59:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Volume volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc (d2460fe6-aba1-4f38-8a2c-10feba374bfc): created successfully Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8b315a-88f8-4769-8050-619d4eca6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Flow 'volume_create_manager' (9f7eb84f-4fdb-43e5-b328-eb1c0942c54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30bb2d9a-3c16-464a-a74a-32086154a713 tempest-GroupsTest-1103168844 None] Create group completed successfully. Jul 16 12:59:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c4c72837-d216-47ab-84b2-888a3c37ab27 tempest-VolumesCloneTest-808787959 None] Created volume successfully. Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (3a0af5d8-33c8-4fb0-a300-a96e3e62500b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7b4b5f-fbeb-4e87-939d-e300c1d64ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Flow 'volume_create_manager' (aee2dad6-d3ea-4906-80f5-b08d45f6c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80afaa9-696b-4663-a447-f0c4ead47b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80afaa9-696b-4663-a447-f0c4ead47b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1419976841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=686d255b-8d7e-4723-a774-a214a227d4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea8facef068466ebf75bbf556bbd2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d2460fe6-aba1-4f38-8a2c-10feba374bfc,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:13Z,use_quota=True,user_id='88c5e322567e42b9862daa8033121c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca7942f-edd4-43b4-8651-321cdb7d06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca7942f-edd4-43b4-8651-321cdb7d06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eadb3e-1908-4522-87c2-57d8bcb2e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7b4b5f-fbeb-4e87-939d-e300c1d64ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460714004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb7b028-9397-4fd1-b972-96e3efce8093,host='devstack@QuobyteHD#QuobyteHD',id=36899255-d735-4456-820f-b3d4431b72df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:13Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc0e636-9632-4f63-87c5-7f8d7422d399),volume_type_id=efc0e636-9632-4f63-87c5-7f8d7422d399)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce2a14b-3446-4ef4-8924-82a08c4bff58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce2a14b-3446-4ef4-8924-82a08c4bff58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97275c09-071d-43bb-9775-ae5529949dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97275c09-071d-43bb-9775-ae5529949dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36899255-d735-4456-820f-b3d4431b72df', 'volume_name': 'volume-36899255-d735-4456-820f-b3d4431b72df', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c186391-e47a-409a-bd90-997e1a167834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c186391-e47a-409a-bd90-997e1a167834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19719353-a38a-4ffd-bee1-bbfcfd09445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Volume 36899255-d735-4456-820f-b3d4431b72df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36899255-d735-4456-820f-b3d4431b72df', 'volume_size': 1} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fb7b028-9397-4fd1-b972-96e3efce8093,created_at=2026-07-16T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460714004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fb7b028-9397-4fd1-b972-96e3efce8093,host='devstack@QuobyteHD#QuobyteHD',id=36899255-d735-4456-820f-b3d4431b72df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:13Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc0e636-9632-4f63-87c5-7f8d7422d399),volume_type_id=efc0e636-9632-4f63-87c5-7f8d7422d399)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Creating volume 36899255-d735-4456-820f-b3d4431b72df {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8eadb3e-1908-4522-87c2-57d8bcb2e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '686d255b-8d7e-4723-a774-a214a227d4ae', 'volume_name': 'volume-686d255b-8d7e-4723-a774-a214a227d4ae', 'volume_size': 2, 'source_volid': 'd2460fe6-aba1-4f38-8a2c-10feba374bfc', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df 1073741824 Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeee245-1cd5-4206-9272-5ef97fe11a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aeee245-1cd5-4206-9272-5ef97fe11a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31eb128-2b6f-4353-bd1b-2d31dd620b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Volume 686d255b-8d7e-4723-a774-a214a227d4ae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-686d255b-8d7e-4723-a774-a214a227d4ae', 'volume_size': 2, 'source_volid': 'd2460fe6-aba1-4f38-8a2c-10feba374bfc', 'source_volstatus': 'available'} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:13 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df 1073741824" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:13 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df Jul 16 12:59:13 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:13 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.767s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Cloning volume d2460fe6-aba1-4f38-8a2c-10feba374bfc to volume 686d255b-8d7e-4723-a774-a214a227d4ae Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19719353-a38a-4ffd-bee1-bbfcfd09445a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36899255-d735-4456-820f-b3d4431b72df', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed1dca-e47d-4d72-af2e-aeda6f21ef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Volume volume-36899255-d735-4456-820f-b3d4431b72df (36899255-d735-4456-820f-b3d4431b72df): created successfully Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ed1dca-e47d-4d72-af2e-aeda6f21ef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (3a0af5d8-33c8-4fb0-a300-a96e3e62500b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Creating offline snapshot 796f6740-349e-466c-9166-848c9b79bade of volume d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-28af063a-169b-43cd-8f94-78c5b3c87c36 tempest-GroupsTest-1103168844 None] Created volume successfully. Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f13f62e-6cfc-413e-b5b5-469ff027c1e2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:14 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:14 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:14 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:14 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade 1G Jul 16 12:59:14 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (419d1ff0-53f9-4754-89e9-78d1d2eb39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07472910-d7be-4a82-8959-78216ca98944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07472910-d7be-4a82-8959-78216ca98944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-165957849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6a8382-1b0f-4c6d-8601-f8ac27721778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198427a23671498796ffd100b4df1a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:14Z,use_quota=True,user_id='d0c742af5d4e4cbaae63a3a4b002b091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd05f712-9290-486b-a569-3afea7ec9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd05f712-9290-486b-a569-3afea7ec9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4762d108-20fb-475b-a5a3-eaeeca0dda83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4762d108-20fb-475b-a5a3-eaeeca0dda83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6a8382-1b0f-4c6d-8601-f8ac27721778', 'volume_name': 'volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79af555c-1237-4e89-8c57-8dd0ce4ca00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79af555c-1237-4e89-8c57-8dd0ce4ca00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba19f37a-f48e-434e-9bd2-28ee53fed02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778', 'volume_size': 1} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:14 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade 1G" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:14 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:14 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:15 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:15 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade is being set with open permissions: ugo+rw Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:15 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:15 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:15 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:15 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info Jul 16 12:59:15 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Acquiring lock "cinder-quobyte-36899255-d735-4456-820f-b3d4431b72df" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-36899255-d735-4456-820f-b3d4431b72df" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745594c-5c80-482e-887d-96c08bbd51f0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:15 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:15 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info is being set with open permissions: ugo+rw Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:15 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info Jul 16 12:59:15 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:15 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df Jul 16 12:59:15 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:15 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.info" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] snapshot: 796f6740-349e-466c-9166-848c9b79bade, volume: 686d255b-8d7e-4723-a774-a214a227d4ae, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a17d82c-e3e7-47d9-9eae-11dd15a0ff81]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:16 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:16 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df Jul 16 12:59:16 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:16 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:16 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:16 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-36899255-d735-4456-820f-b3d4431b72df" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-36899255-d735-4456-820f-b3d4431b72df" released by "delete_volume" :: held 0.682s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:16 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c89d7-25aa-4b08-88f0-c2030a5f463b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Created reservations ['2a874099-1fc4-4e40-9d5f-162470f34a46'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:16 devstack cinder-volume[87560]: WARNING cinder.quota [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1111555133 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1111555133, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:59:16 devstack cinder-volume[87560]: WARNING cinder.quota [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1111555133 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1111555133, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Created reservations ['161c2da0-12a0-41ff-befa-f7cee17e8e8e', 'db6c1e70-edbe-401a-939f-17787980904e', '230a26e5-880c-4c75-9782-0582d1f4baee', '84e91f99-b66e-4e37-bd7e-ef8c6cb59364'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:16 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:16 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:16 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:16 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:16 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.374s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:16 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae Jul 16 12:59:16 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:16 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34886b09-6f65-4257-ad35-8c6d56fc4fb8 tempest-GroupsTest-1103168844 None] Delete group completed successfully. Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Created reservations ['a42f6bd3-ec9a-4702-ab60-b6dd8c12c16a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:17 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:17 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:17 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:17 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6bca5b41-296a-4148-ae4a-0c4e0005ce50 tempest-GroupsTest-1103168844 None] Delete group completed successfully. Jul 16 12:59:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de62dd41-510e-4309-abe9-d1fca920f0cb tempest-GroupsTest-1103168844 None] Group tempest-GroupsTest-Group-299676979: creating Jul 16 12:59:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de62dd41-510e-4309-abe9-d1fca920f0cb tempest-GroupsTest-1103168844 None] Group tempest-GroupsTest-Group-299676979: created successfully Jul 16 12:59:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de62dd41-510e-4309-abe9-d1fca920f0cb tempest-GroupsTest-1103168844 None] Create group completed successfully. Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (03a391b3-a3d9-4859-ab52-7e6a875f26e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a80bef-1780-49be-9998-683cbcfe1adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a80bef-1780-49be-9998-683cbcfe1adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863733644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c31359d-6095-4491-8c02-f72660c197d4,host='devstack@QuobyteHD#QuobyteHD',id=670eacf3-a4cc-449f-9671-20a14027f203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:21Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387613bd-1580-491b-8a35-70bad29b8c7c),volume_type_id=387613bd-1580-491b-8a35-70bad29b8c7c)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e534198-61d5-4748-859e-cd127a17e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e534198-61d5-4748-859e-cd127a17e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794ec75d-9820-4064-bea9-4fe9dccf20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794ec75d-9820-4064-bea9-4fe9dccf20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670eacf3-a4cc-449f-9671-20a14027f203', 'volume_name': 'volume-670eacf3-a4cc-449f-9671-20a14027f203', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398dd6ae-2b96-4b88-a223-46885bec27b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398dd6ae-2b96-4b88-a223-46885bec27b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c891d2cf-099d-428d-96c2-3739ef350cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Volume 670eacf3-a4cc-449f-9671-20a14027f203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670eacf3-a4cc-449f-9671-20a14027f203', 'volume_size': 1} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:21 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae" returned: 0 in 4.785s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[58faae4f-48a6-42e7-bffd-e623eb155d08]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:21 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:21 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:22 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.528s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:59:22 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Converted 1024.00 MB image at 213.93 MB/s Jul 16 12:59:22 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae is being set with open permissions: ugo+rw Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:22 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae Jul 16 12:59:22 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:22 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" released by "_copy_volume_from_snapshot" :: held 6.373s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-quobyte-796f6740-349e-466c-9166-848c9b79bade" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-796f6740-349e-466c-9166-848c9b79bade" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Deleting offline snapshot 796f6740-349e-466c-9166-848c9b79bade of volume d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] snapshot_file for this snap is: volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d32f6-99cc-4fcc-9e19-ea7476ec8b4c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:22 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:22 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:22 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6b2a0-438b-435e-a5b8-dd07cab39ac3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:22 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:22 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:23 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:23 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:23 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:23 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:23 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade Jul 16 12:59:23 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:23 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc.796f6740-349e-466c-9166-848c9b79bade" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-796f6740-349e-466c-9166-848c9b79bade" released by "_delete_snapshot" :: held 1.366s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.838s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.169s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-165957849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6a8382-1b0f-4c6d-8601-f8ac27721778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198427a23671498796ffd100b4df1a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:14Z,use_quota=True,user_id='d0c742af5d4e4cbaae63a3a4b002b091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Creating volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31eb128-2b6f-4353-bd1b-2d31dd620b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-686d255b-8d7e-4723-a774-a214a227d4ae', 'volume_size': 2, 'source_volid': 'd2460fe6-aba1-4f38-8a2c-10feba374bfc', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9122c6d-b8dc-4072-8792-c81ae74c0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:23 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 1073741824 Jul 16 12:59:23 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Volume volume-686d255b-8d7e-4723-a774-a214a227d4ae (686d255b-8d7e-4723-a774-a214a227d4ae): created successfully Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9122c6d-b8dc-4072-8792-c81ae74c0f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Flow 'volume_create_manager' (aee2dad6-d3ea-4906-80f5-b08d45f6c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ffa3bda2-24b2-4fd8-95b0-4a79ab32323d tempest-VolumesCloneTest-808787959 None] Created volume successfully. Jul 16 12:59:24 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 1073741824" returned: 0 in 0.447s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:24 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:24 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:24 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.232s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c31359d-6095-4491-8c02-f72660c197d4,created_at=2026-07-16T10:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863733644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c31359d-6095-4491-8c02-f72660c197d4,host='devstack@QuobyteHD#QuobyteHD',id=670eacf3-a4cc-449f-9671-20a14027f203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:21Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387613bd-1580-491b-8a35-70bad29b8c7c),volume_type_id=387613bd-1580-491b-8a35-70bad29b8c7c)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Creating volume 670eacf3-a4cc-449f-9671-20a14027f203 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:24 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 1073741824 Jul 16 12:59:24 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba19f37a-f48e-434e-9bd2-28ee53fed02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f0bdc-dfaa-4e98-b0c5-e68bb8736c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-686d255b-8d7e-4723-a774-a214a227d4ae-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Volume volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 (4e6a8382-1b0f-4c6d-8601-f8ac27721778): created successfully Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384f0bdc-dfaa-4e98-b0c5-e68bb8736c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (419d1ff0-53f9-4754-89e9-78d1d2eb39f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "cinder-686d255b-8d7e-4723-a774-a214a227d4ae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b18f209d-ff3b-46e9-8379-f3e972a160bf tempest-VolumesDeleteCascade-1906101352 None] Created volume successfully. Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb320848-a943-44cc-a69b-c4792a345125]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:24 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae Jul 16 12:59:24 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:24 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 1073741824" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 Jul 16 12:59:25 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:25 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae Jul 16 12:59:25 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:25 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c891d2cf-099d-428d-96c2-3739ef350cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670eacf3-a4cc-449f-9671-20a14027f203', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821bbdd-bc05-4863-9525-3d729a408835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Volume volume-670eacf3-a4cc-449f-9671-20a14027f203 (670eacf3-a4cc-449f-9671-20a14027f203): created successfully Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821bbdd-bc05-4863-9525-3d729a408835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (03a391b3-a3d9-4859-ab52-7e6a875f26e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-90a3fe62-0c86-40dc-b063-bae07ed5d99b tempest-GroupsTest-1103168844 None] Created volume successfully. Jul 16 12:59:25 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-686d255b-8d7e-4723-a774-a214a227d4ae" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-686d255b-8d7e-4723-a774-a214a227d4ae" released by "delete_volume" :: held 0.708s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Created reservations ['4af3f65d-a87c-464a-8a0e-a9e3075f9be8', '6958406e-ec3b-4985-851c-ebf9f80b35eb', '3cc51bd0-1e33-4a6d-886e-35fd6d227e88', 'b3c47590-5bfa-4b9b-9346-f7ab09980310'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Creating offline snapshot 4bbfe45a-0696-47c6-9d6f-0bebe376633e of volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14394c-c167-4ada-b8cc-018393578648]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:25 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:25 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:25 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:25 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-d2460fe6-aba1-4f38-8a2c-10feba374bfc-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Deleted volume successfully. Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "cinder-d2460fe6-aba1-4f38-8a2c-10feba374bfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-23273826-e596-4013-9203-484d5df0974f tempest-VolumesCloneTest-808787959 None] Lock "cinder-686d255b-8d7e-4723-a774-a214a227d4ae-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Acquiring lock "cinder-quobyte-d2460fe6-aba1-4f38-8a2c-10feba374bfc" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:25 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-d2460fe6-aba1-4f38-8a2c-10feba374bfc" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fca442-c7dc-413d-9689-c0ace68aaa07]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:25 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e 1G Jul 16 12:59:25 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:26 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:26 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:26 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:26 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:26 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e 1G" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:26 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:26 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:26 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (b7352dc8-826d-4c92-be0e-b796aa827247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16855b06-cd32-4c08-bde3-a28c78c38d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16855b06-cd32-4c08-bde3-a28c78c38d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018741990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c31359d-6095-4491-8c02-f72660c197d4,host='devstack@QuobyteHD#QuobyteHD',id=1b52de7b-a741-433a-9c65-58b007fc57d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:26Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387613bd-1580-491b-8a35-70bad29b8c7c),volume_type_id=387613bd-1580-491b-8a35-70bad29b8c7c)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34d3e18-560c-4418-ab71-240bfa28c1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34d3e18-560c-4418-ab71-240bfa28c1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d96466-d111-4e03-913e-0b463db11e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d96466-d111-4e03-913e-0b463db11e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b52de7b-a741-433a-9c65-58b007fc57d9', 'volume_name': 'volume-1b52de7b-a741-433a-9c65-58b007fc57d9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315348f8-b460-4d4d-b991-ef79bddb0313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (315348f8-b460-4d4d-b991-ef79bddb0313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f896a7-d84f-4722-88ef-019707ae936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Volume 1b52de7b-a741-433a-9c65-58b007fc57d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b52de7b-a741-433a-9c65-58b007fc57d9', 'volume_size': 1} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:26 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d2460fe6-aba1-4f38-8a2c-10feba374bfc" returned: 0 in 0.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "cinder-quobyte-d2460fe6-aba1-4f38-8a2c-10feba374bfc" released by "delete_volume" :: held 0.804s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:26 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:26 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e is being set with open permissions: ugo+rw Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:26 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:26 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Created reservations ['1a5ef185-edc8-4243-ba15-e0f87a409d92', '12b514e8-257f-4cc8-9626-64e58e2c2d86', 'ee5e9e80-5d67-42f0-b8c9-750054abb959', '5eb6ba56-320d-46ff-b8a2-5cd08b52340b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:26 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:26 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:27 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:27 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info Jul 16 12:59:27 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:27 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Deleted volume successfully. Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2b128be1-0508-40db-aace-bf865bc0381d tempest-VolumesCloneTest-808787959 None] Lock "cinder-d2460fe6-aba1-4f38-8a2c-10feba374bfc-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:27 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:27 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info is being set with open permissions: ugo+rw Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:27 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info Jul 16 12:59:27 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:27 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.info" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c31359d-6095-4491-8c02-f72660c197d4,created_at=2026-07-16T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2018741990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c31359d-6095-4491-8c02-f72660c197d4,host='devstack@QuobyteHD#QuobyteHD',id=1b52de7b-a741-433a-9c65-58b007fc57d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1a7964720af454e8ec5853098b6ab68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:26Z,use_quota=True,user_id='0e27a3df4ebc404d87e98d917e8343d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(387613bd-1580-491b-8a35-70bad29b8c7c),volume_type_id=387613bd-1580-491b-8a35-70bad29b8c7c)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Creating volume 1b52de7b-a741-433a-9c65-58b007fc57d9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:27 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 1073741824 Jul 16 12:59:27 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c4575f8b-1f2a-4a33-84d1-00b491431d51 tempest-VolumesDeleteCascade-1906101352 None] Create snapshot completed successfully Jul 16 12:59:28 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 1073741824" returned: 0 in 0.493s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:28 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 Jul 16 12:59:28 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:28 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f896a7-d84f-4722-88ef-019707ae936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b52de7b-a741-433a-9c65-58b007fc57d9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa7958e-9959-401a-8e13-2909346f0e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Volume volume-1b52de7b-a741-433a-9c65-58b007fc57d9 (1b52de7b-a741-433a-9c65-58b007fc57d9): created successfully Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aa7958e-9959-401a-8e13-2909346f0e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Flow 'volume_create_manager' (b7352dc8-826d-4c92-be0e-b796aa827247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-65eea89f-71bb-435d-b7c2-251446423602 tempest-GroupsTest-1103168844 None] Created volume successfully. Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Creating offline snapshot eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 of volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb07fc6-f3e0-476b-8c1a-2ce058f0eb08]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:29 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:29 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6cc0ebb0-f4ae-4a1b-821e-5d23cbb4c6db tempest-GroupsTest-1103168844 None] Update group completed successfully. Jul 16 12:59:29 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:29 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 1G Jul 16 12:59:29 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:29 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 1G" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:29 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:29 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:30 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:30 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 is being set with open permissions: ugo+rw Jul 16 12:59:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:30 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:30 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:30 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.594s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-92486d63-5f45-4cfb-a6c9-3c19f5812cb7 tempest-VolumesDeleteCascade-1906101352 None] Create snapshot completed successfully Jul 16 12:59:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b4ee72e5-7e08-4cc9-a64c-765b0807e68b tempest-GroupsTest-1103168844 None] Update group completed successfully. Jul 16 12:59:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-4e6a8382-1b0f-4c6d-8601-f8ac27721778-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-4e6a8382-1b0f-4c6d-8601-f8ac27721778-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Performing cascade delete. {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-4bbfe45a-0696-47c6-9d6f-0bebe376633e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-4bbfe45a-0696-47c6-9d6f-0bebe376633e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-4bbfe45a-0696-47c6-9d6f-0bebe376633e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4bbfe45a-0696-47c6-9d6f-0bebe376633e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Deleting offline snapshot 4bbfe45a-0696-47c6-9d6f-0bebe376633e of volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] snapshot_file for this snap is: volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a60af77-7f01-456d-a1aa-0da672063961]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:31 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:31 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:31 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f559c451-6fe7-4e97-871f-7cf137b7e83b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:31 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:31 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:31 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ff1477-a4c1-4095-9c2d-c7b10ae17bf0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:32 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:32 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Acquiring lock "cinder-quobyte-1b52de7b-a741-433a-9c65-58b007fc57d9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-1b52de7b-a741-433a-9c65-58b007fc57d9" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a63d1d-b6b0-406b-926c-c0d84ffae99a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:32 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 Jul 16 12:59:32 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:32 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53411cb-9764-4e2a-90e1-b791cc2d7370]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:32 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:32 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:32 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:32 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9 Jul 16 12:59:32 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:32 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2389c4-ad22-4777-84d6-21928843313f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:33 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:33 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:33 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1b52de7b-a741-433a-9c65-58b007fc57d9" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-1b52de7b-a741-433a-9c65-58b007fc57d9" released by "delete_volume" :: held 0.774s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Acquiring lock "cinder-quobyte-670eacf3-a4cc-449f-9671-20a14027f203" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-670eacf3-a4cc-449f-9671-20a14027f203" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[21817f4a-451f-432d-aedd-9df1896d51df]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:33 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 Jul 16 12:59:33 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:33 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:33 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:33 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:33 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203" returned: 0 in 0.424s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:33 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203 Jul 16 12:59:33 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:33 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:33 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e Jul 16 12:59:33 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:33 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-670eacf3-a4cc-449f-9671-20a14027f203" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "cinder-quobyte-670eacf3-a4cc-449f-9671-20a14027f203" released by "delete_volume" :: held 0.860s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Created reservations ['23e0cbc0-3662-450a-909d-5bd004ed3040'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:34 devstack cinder-volume[87560]: WARNING cinder.quota [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2106854713 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2106854713, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:59:34 devstack cinder-volume[87560]: WARNING cinder.quota [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2106854713 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2106854713, it is now deprecated. Please use the default quota class for default quota. Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Created reservations ['18ebf387-9f92-41bc-b9cb-527beef75ed1', '98bd4512-096f-4060-9844-a5cd796d8d6a', 'e7e106eb-83ef-4e18-8778-6f1b32588e28', '1f973d69-e288-4fe9-903a-ab4d2bcf9bba'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:34 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.4bbfe45a-0696-47c6-9d6f-0bebe376633e" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 -F qcow2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:34 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 -F qcow2 Jul 16 12:59:34 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Created reservations ['cfd84596-6d41-485f-bb75-7b159e505fc0', 'd530d2dc-4164-4fa3-9604-b83eb08c576a', 'ce5c8d09-6e9a-4d3f-984f-fe8179ae0a7e', '50e14415-e1de-4108-b1b2-e99dad7f21ff'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:34 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:34 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:34 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 -F qcow2" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4bbfe45a-0696-47c6-9d6f-0bebe376633e" released by "_delete_snapshot" :: held 3.391s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" released by "delete_snapshot" :: held 3.417s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['75e5134e-6861-46b7-998d-3b1d38e3d3eb', 'f9057c9a-708d-45db-b0f4-6084130f9efc', '9fb76984-52d1-4f98-88cb-958232795727', '660ec01d-653e-40ce-8bc3-85b74227638d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:34 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0dbdb25b-0ee5-4919-9ddc-edef1ba81343 tempest-GroupsTest-1103168844 None] Delete group completed successfully. Jul 16 12:59:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Delete snapshot completed successfully. Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-4bbfe45a-0696-47c6-9d6f-0bebe376633e-delete_snapshot" released by "delete_snapshot" :: held 3.637s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Deleting offline snapshot eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 of volume 4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] snapshot_file for this snap is: volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b833e-995c-46eb-b4f5-cde89d0ca21c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:34 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:34 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:35 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b9dcd3-b837-4d7f-a4b0-9099d8738b1a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:35 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:35 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:35 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.469s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:35 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:35 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:36 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:36 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814 Jul 16 12:59:36 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:36 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778.eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814" released by "_delete_snapshot" :: held 1.743s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" released by "delete_snapshot" :: held 1.778s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['d2017d2d-4a0f-4b09-9ff5-3688f9d96510', '5f59f1ea-23fb-4d69-b744-639bd99ceedd', '9e0a2c88-cd1b-4309-b023-af44d17f30ce', '8f3f55dd-e5e2-48c5-a76b-e48cba1f6cea'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Delete snapshot completed successfully. Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-eaf8fc2c-631f-4b22-bcad-d8a12d5a4814-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Snapshots deleted, issuing volume delete {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[82412d01-0c2d-4719-9a86-15e9f03c5a8c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:37 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:37 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:37 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.456s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:37 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778 Jul 16 12:59:37 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:37 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4e6a8382-1b0f-4c6d-8601-f8ac27721778" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-4e6a8382-1b0f-4c6d-8601-f8ac27721778" released by "delete_volume" :: held 0.859s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['e4c42f4e-ea1b-44a1-8656-b1d1332f18d8', '5669a0a8-7c7a-43aa-98c6-5905f2d5af3c', '05c02d10-3fca-4bbf-8fbd-bc3c5f8653d5', '31c96a0b-0877-44f8-9d64-7a6038247800'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:37 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:37 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:38 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Deleted volume successfully. Jul 16 12:59:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46703188-1658-46da-ad37-855d2a775af8 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-4e6a8382-1b0f-4c6d-8601-f8ac27721778-delete_volume" released by "delete_volume" :: held 7.124s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=124,cinder:INSERT=41,cinder:UPDATE=160,cinder:DELETE=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=146,cinder:DELETE=14,cinder:SELECT=125,cinder:INSERT=32 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (e908132f-aeca-4d3d-af36-e73c90e7af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ec3b4a-1786-42be-8606-22f563162943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ec3b4a-1786-42be-8606-22f563162943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544356462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5469fd5b-d513-44eb-a599-c1a691972f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198427a23671498796ffd100b4df1a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:39Z,use_quota=True,user_id='d0c742af5d4e4cbaae63a3a4b002b091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f074b9-9447-4ce9-999d-9a14b8a91212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f074b9-9447-4ce9-999d-9a14b8a91212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f9bf70-3cb8-41ec-9b41-bd3c401e9b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f9bf70-3cb8-41ec-9b41-bd3c401e9b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5469fd5b-d513-44eb-a599-c1a691972f39', 'volume_name': 'volume-5469fd5b-d513-44eb-a599-c1a691972f39', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca83ead-931d-43a6-950a-3baa174ffc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca83ead-931d-43a6-950a-3baa174ffc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46084ed-159a-44ea-9fb1-5e9b9d17892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Volume 5469fd5b-d513-44eb-a599-c1a691972f39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5469fd5b-d513-44eb-a599-c1a691972f39', 'volume_size': 1} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544356462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5469fd5b-d513-44eb-a599-c1a691972f39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198427a23671498796ffd100b4df1a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:39Z,use_quota=True,user_id='d0c742af5d4e4cbaae63a3a4b002b091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Creating volume 5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:39 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 1073741824 Jul 16 12:59:39 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:40 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 1073741824" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:40 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:40 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:40 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46084ed-159a-44ea-9fb1-5e9b9d17892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5469fd5b-d513-44eb-a599-c1a691972f39', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f8f657-f052-49ea-8ef3-fc921670cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Volume volume-5469fd5b-d513-44eb-a599-c1a691972f39 (5469fd5b-d513-44eb-a599-c1a691972f39): created successfully Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f8f657-f052-49ea-8ef3-fc921670cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (e908132f-aeca-4d3d-af36-e73c90e7af37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f1dc739d-5e22-4285-ab59-48626e03dc44 tempest-VolumesDeleteCascade-1906101352 None] Created volume successfully. Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (a028f190-9715-402e-ba31-3803380dd961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a10faf3-73cb-4778-8764-8c391b145251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a10faf3-73cb-4778-8764-8c391b145251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1017428051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:41Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6e100-d7ea-49ce-a53c-9d3d76c61d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6e100-d7ea-49ce-a53c-9d3d76c61d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9171d114-0ac8-452e-89ab-ed5548435b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9171d114-0ac8-452e-89ab-ed5548435b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5', 'volume_name': 'volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc1c97f-4c61-4e31-a8b0-a934e8d19d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc1c97f-4c61-4e31-a8b0-a934e8d19d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e406ab9-3930-46f0-a1e8-70c85b41bf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Volume 2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5', 'volume_size': 1} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1017428051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:41Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Creating volume 2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:41 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 1073741824 Jul 16 12:59:41 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:42 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 1073741824" returned: 0 in 0.481s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:42 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 Jul 16 12:59:42 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:42 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.585s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Creating offline snapshot 77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 of volume 5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e406ab9-3930-46f0-a1e8-70c85b41bf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eb9307-ca3d-4601-ae81-8f66733f2c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e26e42-5b67-45f9-b579-0ee8501f86ae]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Volume volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 (2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5): created successfully Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eb9307-ca3d-4601-ae81-8f66733f2c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (a028f190-9715-402e-ba31-3803380dd961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-db4f5b2e-3204-4ce3-9f37-51dec2854a5c tempest-VolumesSnapshotTestJSON-269030534 None] Created volume successfully. Jul 16 12:59:42 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:42 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:42 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:42 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 1G Jul 16 12:59:42 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:43 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 1G" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5469fd5b-d513-44eb-a599-c1a691972f39 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:43 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5469fd5b-d513-44eb-a599-c1a691972f39 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:43 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:43 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5469fd5b-d513-44eb-a599-c1a691972f39 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:43 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 is being set with open permissions: ugo+rw Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:43 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:43 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:43 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:43 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info Jul 16 12:59:43 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:44 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:44 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info is being set with open permissions: ugo+rw Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:44 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info Jul 16 12:59:44 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:44 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.info" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.640s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Creating offline snapshot d56699ca-25a6-4f4b-a63e-91ec8defeba8 of volume 2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eccaed3f-92f6-42b4-9f76-4f4a2194ed3d tempest-VolumesDeleteCascade-1906101352 None] Create snapshot completed successfully Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e4cdb-fee7-4451-a5a3-63e1ad05dc03]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:44 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 Jul 16 12:59:44 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:44 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:45 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 1G Jul 16 12:59:45 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:45 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 1G" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:45 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 Jul 16 12:59:45 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (f35e5ca5-2ec2-464b-af09-2817d18c82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199cb844-eaeb-4dbd-9a1c-e4ebdd76ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199cb844-eaeb-4dbd-9a1c-e4ebdd76ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1219703692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d578707-8838-48e2-9137-5e696f567147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198427a23671498796ffd100b4df1a6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:45Z,use_quota=True,user_id='d0c742af5d4e4cbaae63a3a4b002b091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f457bec-561b-425b-b6fa-1c07fe678871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f457bec-561b-425b-b6fa-1c07fe678871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea69fb6e-a945-4449-a23f-d1aeb93c494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea69fb6e-a945-4449-a23f-d1aeb93c494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d578707-8838-48e2-9137-5e696f567147', 'volume_name': 'volume-5d578707-8838-48e2-9137-5e696f567147', 'volume_size': 1, 'snapshot_id': '77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d1994a-2a0e-4c15-9afe-b46e643f2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d1994a-2a0e-4c15-9afe-b46e643f2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd16ee-d390-422c-bdd1-970f58d71e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:45 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Volume 5d578707-8838-48e2-9137-5e696f567147: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d578707-8838-48e2-9137-5e696f567147', 'volume_size': 1, 'snapshot_id': '77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4'} Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:45 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:45 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 is being set with open permissions: ugo+rw Jul 16 12:59:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:45 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 Jul 16 12:59:45 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:46 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:46 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info Jul 16 12:59:46 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:46 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info is being set with open permissions: ugo+rw Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:46 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info Jul 16 12:59:46 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:46 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.945s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-5d578707-8838-48e2-9137-5e696f567147" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-5d578707-8838-48e2-9137-5e696f567147" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Creating volume 5d578707-8838-48e2-9137-5e696f567147 from snapshot 77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] snapshot: 77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4, volume: 5d578707-8838-48e2-9137-5e696f567147, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9fcebb09-a9ad-4072-8ca4-80aabdb97537 tempest-VolumesSnapshotTestJSON-269030534 None] Create snapshot completed successfully Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91cf75-6c0e-449b-81b6-4203aac3f567]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:46 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:46 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:47 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5469fd5b-d513-44eb-a599-c1a691972f39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8da0f0-fd91-4ab7-a4b9-8a5b4dbc5fb7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-d56699ca-25a6-4f4b-a63e-91ec8defeba8-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-d56699ca-25a6-4f4b-a63e-91ec8defeba8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:47 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:47 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-d56699ca-25a6-4f4b-a63e-91ec8defeba8" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-d56699ca-25a6-4f4b-a63e-91ec8defeba8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Deleting offline snapshot d56699ca-25a6-4f4b-a63e-91ec8defeba8 of volume 2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] snapshot_file for this snap is: volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74333fe6-84cc-4b92-b390-14ab5b193954]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:47 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 Jul 16 12:59:47 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:47 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:47 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 Jul 16 12:59:47 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:47 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8" returned: 0 in 0.405s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee0af1-c3e0-4c0e-ab19-616bd8f718ab]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:47 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 Jul 16 12:59:47 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:48 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" returned: 0 in 0.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:48 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 Jul 16 12:59:48 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:49 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8" returned: 0 in 1.110s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:49 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8 Jul 16 12:59:49 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:50 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5.d56699ca-25a6-4f4b-a63e-91ec8defeba8" returned: 0 in 0.635s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-d56699ca-25a6-4f4b-a63e-91ec8defeba8" released by "_delete_snapshot" :: held 2.812s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" released by "delete_snapshot" :: held 2.846s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['fe7d50ed-64e0-4cfe-a9b7-c69223660838', '99565556-d24a-4ad6-b3f6-19ceea55aa7c', '3deaca01-b2b3-4fe3-a22c-81b6fc166a2d', '3fb721cc-d225-4db9-bce9-030c3518126e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Delete snapshot completed successfully. Jul 16 12:59:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b6f7046a-e1c5-4257-afa7-f2143cdce854 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-d56699ca-25a6-4f4b-a63e-91ec8defeba8-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (56186095-04b8-4cdd-a7f4-e7df0aa863b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d439a89-7cbf-4125-85ce-eef4825e2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d439a89-7cbf-4125-85ce-eef4825e2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-809425217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63be7510-9665-4db1-b2bf-a9bfafad75b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:52Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e5bf7-772f-4834-b189-5e34636bf0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1e5bf7-772f-4834-b189-5e34636bf0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b28b78-9e1f-4e54-a20d-52eed1cfd4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b28b78-9e1f-4e54-a20d-52eed1cfd4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63be7510-9665-4db1-b2bf-a9bfafad75b8', 'volume_name': 'volume-63be7510-9665-4db1-b2bf-a9bfafad75b8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c567808d-b543-4fff-8b35-0618f195e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c567808d-b543-4fff-8b35-0618f195e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42ea89b-1186-4596-b4ed-5e7d6cf33638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Volume 63be7510-9665-4db1-b2bf-a9bfafad75b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63be7510-9665-4db1-b2bf-a9bfafad75b8', 'volume_size': 1} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:52 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147" returned: 0 in 5.115s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a8a9d5-0df2-4900-8bd5-f9c82d779c98]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:52 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:52 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:53 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.557s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39, size 1024.00 MB, duration 5.12 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 12:59:53 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Converted 1024.00 MB image at 200.15 MB/s Jul 16 12:59:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 is being set with open permissions: ugo+rw Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:53 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 Jul 16 12:59:53 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:53 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" released by "_copy_volume_from_snapshot" :: held 6.872s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-5d578707-8838-48e2-9137-5e696f567147" released by "_create_volume_from_snapshot" :: held 6.911s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.942s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-809425217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63be7510-9665-4db1-b2bf-a9bfafad75b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:52Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Creating volume 63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:53 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:53 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 1073741824 Jul 16 12:59:53 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afd16ee-d390-422c-bdd1-970f58d71e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d578707-8838-48e2-9137-5e696f567147', 'volume_size': 1, 'snapshot_id': '77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9de595-43a3-4a0f-82e1-a124f0ca2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:53 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Volume volume-5d578707-8838-48e2-9137-5e696f567147 (5d578707-8838-48e2-9137-5e696f567147): created successfully Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9de595-43a3-4a0f-82e1-a124f0ca2565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Flow 'volume_create_manager' (f35e5ca5-2ec2-464b-af09-2817d18c82d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2640b479-688a-4d91-89ea-dd6b5d744d78 tempest-VolumesDeleteCascade-1906101352 None] Created volume successfully. Jul 16 12:59:54 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 1073741824" returned: 0 in 0.461s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:54 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 12:59:54 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:54 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42ea89b-1186-4596-b4ed-5e7d6cf33638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63be7510-9665-4db1-b2bf-a9bfafad75b8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9610b311-bb56-4abe-a4b2-7a4e296a4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Volume volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 (63be7510-9665-4db1-b2bf-a9bfafad75b8): created successfully Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9610b311-bb56-4abe-a4b2-7a4e296a4404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (56186095-04b8-4cdd-a7f4-e7df0aa863b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ed21e1ac-8756-430d-9ac0-af8a56c8c952 tempest-VolumesSnapshotTestJSON-269030534 None] Created volume successfully. Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-5469fd5b-d513-44eb-a599-c1a691972f39-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-5469fd5b-d513-44eb-a599-c1a691972f39-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Performing cascade delete. {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Deleting offline snapshot 77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 of volume 5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] snapshot_file for this snap is: volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01df65a-7051-4945-b341-bc1d49048fec]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:54 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:54 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:55 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5469fd5b-d513-44eb-a599-c1a691972f39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ca043-c569-4f53-80f8-143696b079be]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:55 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:55 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Creating offline snapshot f6db5214-35c8-4ed2-9c67-e321e40d20bb of volume 63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d60f4f6-d05a-4456-a67b-9debf014451e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:55 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 12:59:55 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:55 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.441s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:55 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:55 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:55 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:55 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb 1G Jul 16 12:59:55 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:55 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4 Jul 16 12:59:56 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:56 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb 1G" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39.77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 12:59:56 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4" released by "_delete_snapshot" :: held 1.591s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" released by "delete_snapshot" :: held 1.613s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['38d2d86f-1702-4c81-a6d9-ca04792d882d', '61cefbff-6b06-4f65-8584-084e65165e6a', 'd204c1b4-e5f0-465b-bbdd-43a0f2413543', 'b8da969a-1690-45fb-995c-3408ddf4aa93'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Delete snapshot completed successfully. Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-77a3f0ba-a9ce-4c69-ad0c-76c957ad78a4-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Snapshots deleted, issuing volume delete {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a6d2e2-517e-466c-8f7e-36a303fa3865]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb is being set with open permissions: ugo+rw Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 12:59:56 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:56 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:56 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:56 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info Jul 16 12:59:56 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:56 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:56 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39 Jul 16 12:59:56 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:57 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:57 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info is being set with open permissions: ugo+rw Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:57 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:57 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info Jul 16 12:59:57 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5469fd5b-d513-44eb-a599-c1a691972f39" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5469fd5b-d513-44eb-a599-c1a691972f39" released by "delete_volume" :: held 0.730s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['af373854-89b2-4b37-b8ad-492f9f910bed', '4efe3206-8c24-4629-9b2c-3e89ee8cf85a', '87a4b93f-5a93-427f-ba17-4a1f5fc837b5', '6dd77490-7d1e-48ae-8376-fd069f1d3e93'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:57 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:57 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:57 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.info" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e5f50671-f51a-4467-aa9d-94bed6b60c59 tempest-VolumesSnapshotTestJSON-269030534 None] Create snapshot completed successfully Jul 16 12:59:57 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Deleted volume successfully. Jul 16 12:59:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49fd0bf7-8a9e-436a-9211-650136108aea tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-5469fd5b-d513-44eb-a599-c1a691972f39-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-5d578707-8838-48e2-9137-5e696f567147-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-5d578707-8838-48e2-9137-5e696f567147-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e800e8-7e38-4cab-9f44-63a156b9dd63]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:58 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 Jul 16 12:59:58 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:58 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:58 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147 Jul 16 12:59:58 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:58 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d578707-8838-48e2-9137-5e696f567147" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-quobyte-5d578707-8838-48e2-9137-5e696f567147" released by "delete_volume" :: held 0.728s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Created reservations ['ccabdc7e-12da-43dc-925e-b4071a862aa1', '6391f8e5-e283-4b9e-ab4a-1ac7fbbb8eaa', 'c7996d35-8ae8-4122-94ac-261ba95d8d21', 'f2652f2a-7b19-48f2-97a8-a1aacae12fdc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Flow 'volume_create_manager' (3dd710ba-7a1d-4736-86f2-3f13c6f2e58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b7543d-b21a-4ce6-834a-c36b753b19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b7543d-b21a-4ce6-834a-c36b753b19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1883322147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb4de79-5849-42be-ac7f-a9b47b2a1f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b53d0433e4397b14838c9cefd2667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:59Z,use_quota=True,user_id='08fad3973b184d2ea218e68db80f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe3bba8-3269-4f08-bdae-d5cfbe7466c8),volume_type_id=7fe3bba8-3269-4f08-bdae-d5cfbe7466c8)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5d7dd-2550-426b-8609-b567d0082210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf5d7dd-2550-426b-8609-b567d0082210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4102a118-088e-40df-be74-c5c9f89767c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4102a118-088e-40df-be74-c5c9f89767c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb4de79-5849-42be-ac7f-a9b47b2a1f50', 'volume_name': 'volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7faf9f2-bae9-4d9f-aea8-8e8be575e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7faf9f2-bae9-4d9f-aea8-8e8be575e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0326f84f-1c91-44bd-a8ce-35f9b179edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Volume fbb4de79-5849-42be-ac7f-a9b47b2a1f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50', 'volume_size': 1} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1883322147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb4de79-5849-42be-ac7f-a9b47b2a1f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b53d0433e4397b14838c9cefd2667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:59Z,use_quota=True,user_id='08fad3973b184d2ea218e68db80f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe3bba8-3269-4f08-bdae-d5cfbe7466c8),volume_type_id=7fe3bba8-3269-4f08-bdae-d5cfbe7466c8)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Creating volume fbb4de79-5849-42be-ac7f-a9b47b2a1f50 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:59 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 1073741824 Jul 16 12:59:59 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:59 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 12:59:59 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (3ac3c82a-5dd0-4851-8027-6ca199eeda7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810661ca-363d-447f-a0ec-80e281295da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810661ca-363d-447f-a0ec-80e281295da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-530534662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d11c03-6395-46b1-9b44-0808bf076d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T10:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f6db5214-35c8-4ed2-9c67-e321e40d20bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T10:59:59Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d819f55-640e-4117-811b-3e980026bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d819f55-640e-4117-811b-3e980026bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8149070-c812-4795-82a2-48d6c930c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8149070-c812-4795-82a2-48d6c930c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6d11c03-6395-46b1-9b44-0808bf076d52', 'volume_name': 'volume-c6d11c03-6395-46b1-9b44-0808bf076d52', 'volume_size': 2, 'snapshot_id': 'f6db5214-35c8-4ed2-9c67-e321e40d20bb'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e14b72-a6fa-445d-811f-cb9c05221b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e14b72-a6fa-445d-811f-cb9c05221b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40382c-8820-485d-af58-69aadb6d2920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume c6d11c03-6395-46b1-9b44-0808bf076d52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6d11c03-6395-46b1-9b44-0808bf076d52', 'volume_size': 2, 'snapshot_id': 'f6db5214-35c8-4ed2-9c67-e321e40d20bb'} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Deleted volume successfully. Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-59ebb80e-1e20-444c-a551-c92a3627b0f2 tempest-VolumesDeleteCascade-1906101352 None] Lock "cinder-5d578707-8838-48e2-9137-5e696f567147-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 12:59:59 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 1073741824" returned: 0 in 0.538s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 12:59:59 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 Jul 16 12:59:59 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 12:59:59 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.536s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb-c6d11c03-6395-46b1-9b44-0808bf076d52" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0326f84f-1c91-44bd-a8ce-35f9b179edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd109008-b1b3-4145-86f9-82bfc18b0bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb-c6d11c03-6395-46b1-9b44-0808bf076d52" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Creating volume c6d11c03-6395-46b1-9b44-0808bf076d52 from snapshot f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Volume volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 (fbb4de79-5849-42be-ac7f-a9b47b2a1f50): created successfully Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd109008-b1b3-4145-86f9-82bfc18b0bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Flow 'volume_create_manager' (3dd710ba-7a1d-4736-86f2-3f13c6f2e58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] snapshot: f6db5214-35c8-4ed2-9c67-e321e40d20bb, volume: c6d11c03-6395-46b1-9b44-0808bf076d52, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 12:59:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-63162bef-44c0-44f0-be2e-6a7f3f6558bb tempest-VolumeTypesAccessTest-352381269 None] Created volume successfully. Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf13b160-f397-4a5f-94ff-f30e722ede54]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 12:59:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:00 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 13:00:00 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:00 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63be7510-9665-4db1-b2bf-a9bfafad75b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af598ae8-e5a3-4de8-97c5-0e963e1a98dc]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:00 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 13:00:00 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:00 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:00:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:00 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 Jul 16 13:00:00 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Acquiring lock "cinder-fbb4de79-5849-42be-ac7f-a9b47b2a1f50-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "cinder-fbb4de79-5849-42be-ac7f-a9b47b2a1f50-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Acquiring lock "cinder-quobyte-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "cinder-quobyte-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57288e8-a3da-469b-8761-455c3eb26071]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:01 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 Jul 16 13:00:01 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:01 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" returned: 0 in 0.816s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:02 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50 Jul 16 13:00:02 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:02 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "cinder-quobyte-fbb4de79-5849-42be-ac7f-a9b47b2a1f50" released by "delete_volume" :: held 1.298s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:02 devstack cinder-volume[87560]: WARNING cinder.quota [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-118930796 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-118930796, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:00:02 devstack cinder-volume[87560]: WARNING cinder.quota [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-118930796 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-118930796, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Created reservations ['77f8f156-0477-42d3-a2d1-eba689f508f9', 'd77f9ced-a357-4a3d-a5d6-d1050d0ab3b1', 'ff78ce41-8524-42e8-9a07-1a667a0bf161', '09a99e65-9b30-4012-9171-0cbcf0a28f4e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:02 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:02 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:03 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.719s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:03 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Deleted volume successfully. Jul 16 13:00:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4eeafb77-532a-4bb0-869f-6b18743ffc90 tempest-VolumeTypesAccessTest-352381269 None] Lock "cinder-fbb4de79-5849-42be-ac7f-a9b47b2a1f50-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:06 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52" returned: 0 in 5.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[38551d5a-6bc9-4ce2-a1f0-9d9c2f664a49]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:06 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 13:00:06 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:06 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.612s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:00:06 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Converted 1024.00 MB image at 189.76 MB/s Jul 16 13:00:06 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 is being set with open permissions: ugo+rw Jul 16 13:00:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:06 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 Jul 16 13:00:06 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:07 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" released by "_copy_volume_from_snapshot" :: held 7.239s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb-c6d11c03-6395-46b1-9b44-0808bf076d52" released by "_create_volume_from_snapshot" :: held 7.297s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.328s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f40382c-8820-485d-af58-69aadb6d2920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d11c03-6395-46b1-9b44-0808bf076d52', 'volume_size': 2, 'snapshot_id': 'f6db5214-35c8-4ed2-9c67-e321e40d20bb'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1ffdd6-070a-43d4-ae37-cd54d18a7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume volume-c6d11c03-6395-46b1-9b44-0808bf076d52 (c6d11c03-6395-46b1-9b44-0808bf076d52): created successfully Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1ffdd6-070a-43d4-ae37-cd54d18a7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (3ac3c82a-5dd0-4851-8027-6ca199eeda7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3800c086-fb8b-44ff-a6d6-29c96575dce6 tempest-VolumesSnapshotTestJSON-269030534 None] Created volume successfully. Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Flow 'volume_create_manager' (509eaad2-1f78-4d43-b7e7-e0e76649dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6296da4-1397-4cdc-81b1-cfb4129e16d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6296da4-1397-4cdc-81b1-cfb4129e16d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140147171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094ea89f-2c64-4603-a1b8-eeec4fdbdfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f8a398fe8244f0b5eaac6a16fd327a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:07Z,use_quota=True,user_id='c90831a3529e4de4b383170b187bc76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3c8c5d-01d4-4533-b6c8-8fd74ebeb08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3c8c5d-01d4-4533-b6c8-8fd74ebeb08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8792c922-e5b1-4631-99f1-d084cfe6046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8792c922-e5b1-4631-99f1-d084cfe6046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094ea89f-2c64-4603-a1b8-eeec4fdbdfcd', 'volume_name': 'volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144bc51c-5f45-4df6-9310-8f3cd268508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144bc51c-5f45-4df6-9310-8f3cd268508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785f5cb-c2ee-40e7-94aa-ba7a4f82bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Volume 094ea89f-2c64-4603-a1b8-eeec4fdbdfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd', 'volume_size': 1} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-140147171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094ea89f-2c64-4603-a1b8-eeec4fdbdfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f8a398fe8244f0b5eaac6a16fd327a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:07Z,use_quota=True,user_id='c90831a3529e4de4b383170b187bc76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Creating volume 094ea89f-2c64-4603-a1b8-eeec4fdbdfcd {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:07 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:07 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd 1073741824 Jul 16 13:00:07 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:07 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd 1073741824" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:07 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd Jul 16 13:00:07 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:08 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785f5cb-c2ee-40e7-94aa-ba7a4f82bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb3011d-79f6-47cd-bbfe-812db3718220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-c6d11c03-6395-46b1-9b44-0808bf076d52-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Volume volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd (094ea89f-2c64-4603-a1b8-eeec4fdbdfcd): created successfully Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb3011d-79f6-47cd-bbfe-812db3718220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Flow 'volume_create_manager' (509eaad2-1f78-4d43-b7e7-e0e76649dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-c6d11c03-6395-46b1-9b44-0808bf076d52-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9ed7259a-1326-437f-b0b8-93aa7c786dcf tempest-VolumesTransfersV357Test-1558034244 None] Created volume successfully. Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c908ba1-84b0-42a9-8968-0f0d9c779681]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:08 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 Jul 16 13:00:08 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:08 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:08 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52 Jul 16 13:00:08 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:08 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:08 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:09 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c6d11c03-6395-46b1-9b44-0808bf076d52" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-c6d11c03-6395-46b1-9b44-0808bf076d52" released by "delete_volume" :: held 0.687s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:09 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['ecee099d-4aed-4381-b894-f0ed907e288b', 'cce55dce-80d5-431e-808b-865dfeca6b7a', '8efd1af1-0fe4-4a2c-92c8-6952102c9afb', 'debcbd8e-6928-4537-8a88-8b44769781c3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:09 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:09 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:09 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Deleted volume successfully. Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-f6db5214-35c8-4ed2-9c67-e321e40d20bb-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ebb9930f-b7a5-499c-9f9c-96f51038b9d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-c6d11c03-6395-46b1-9b44-0808bf076d52-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-f6db5214-35c8-4ed2-9c67-e321e40d20bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Deleting offline snapshot f6db5214-35c8-4ed2-9c67-e321e40d20bb of volume 63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] snapshot_file for this snap is: volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d0fe19-9304-49ca-9352-69353c633477]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:09 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 13:00:09 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:10 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63be7510-9665-4db1-b2bf-a9bfafad75b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0d8cba-944e-43c3-a305-961acabca935]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:10 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 13:00:10 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-32a2995b-a2fc-4e0a-b3c0-2267b8ad6250 tempest-VolumesTransfersV357Test-427704645 None] Transfer volume completed successfully. Jul 16 13:00:10 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:10 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 13:00:10 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:10 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:10 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb Jul 16 13:00:10 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "cinder-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "cinder-quobyte-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-quobyte-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf40714-7e08-4f05-b836-143fed909188]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:11 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8.f6db5214-35c8-4ed2-9c67-e321e40d20bb" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-f6db5214-35c8-4ed2-9c67-e321e40d20bb" released by "_delete_snapshot" :: held 1.707s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" released by "delete_snapshot" :: held 1.732s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:11 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd Jul 16 13:00:11 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['9e72b63e-91f2-4db6-a7e3-c6316b30f52c', 'a0e0b99e-5138-414d-979c-f36c8e3ee1fa', '7d8eeac9-290e-4e0f-aac4-fa779da2285d', '99c53f41-b45c-4d18-9fd8-38fc7a4cdccc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Delete snapshot completed successfully. Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96a13c08-e05a-4763-a276-509f923aea98 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-f6db5214-35c8-4ed2-9c67-e321e40d20bb-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:11 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:11 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd Jul 16 13:00:11 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-63be7510-9665-4db1-b2bf-a9bfafad75b8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-63be7510-9665-4db1-b2bf-a9bfafad75b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[84325033-1757-4b6d-afa3-136d6e63333b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:11 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-quobyte-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd" released by "delete_volume" :: held 0.749s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Created reservations ['035e8bd5-9ded-4ba5-a483-251c36fbfa81', '2a3f71df-5f9f-4fd9-9bab-a322e52c66bb', '9529e4fc-dc10-4a95-903e-df0aef7a08c7', '15cc641e-75e6-4f05-b883-39e155975803'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:12 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 13:00:12 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:12 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:12 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:12 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:12 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Deleted volume successfully. Jul 16 13:00:12 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8 Jul 16 13:00:12 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7c0bb8d-d52b-4fa1-8a29-85219ae8f9ff tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-094ea89f-2c64-4603-a1b8-eeec4fdbdfcd-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (6c6e7eca-0c09-4257-92a2-095c85ca2356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dcbd37-e595-45b6-ba1f-27423cc1f9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dcbd37-e595-45b6-ba1f-27423cc1f9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-46707099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889a3ad1-59f3-4769-8476-434a066f4ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f474c79-82ae-41eb-a389-9f7514bc091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f474c79-82ae-41eb-a389-9f7514bc091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c00635e-2880-4a39-8c93-6f048e4c338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c00635e-2880-4a39-8c93-6f048e4c338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '889a3ad1-59f3-4769-8476-434a066f4ae0', 'volume_name': 'volume-889a3ad1-59f3-4769-8476-434a066f4ae0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872d6ba-2d34-423e-ac37-be9b264449e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a872d6ba-2d34-423e-ac37-be9b264449e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ca0564-fa02-44c2-b1f4-9314d699eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Volume 889a3ad1-59f3-4769-8476-434a066f4ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-889a3ad1-59f3-4769-8476-434a066f4ae0', 'volume_size': 1} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-46707099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=889a3ad1-59f3-4769-8476-434a066f4ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Creating volume 889a3ad1-59f3-4769-8476-434a066f4ae0 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63be7510-9665-4db1-b2bf-a9bfafad75b8" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:12 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 1073741824 Jul 16 13:00:12 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-63be7510-9665-4db1-b2bf-a9bfafad75b8" released by "delete_volume" :: held 0.920s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['bd8725bc-d2d3-497e-860a-af9434edb68f', 'c6645557-84ba-4f4c-97e3-0a9ff1e27cb5', 'c3ed6a62-7c02-4155-bf1d-d121fcfbbbbf', '5c01ab16-0672-4b80-8ef1-620feb9dab03'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Flow 'volume_create_manager' (2bd83f23-7c35-446f-aee6-7e49cbdaff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300daecf-147f-4218-83c6-67730ab3bb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300daecf-147f-4218-83c6-67730ab3bb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1520345671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabe927-95b2-49b9-8242-f7a8cdea8937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f8a398fe8244f0b5eaac6a16fd327a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='c90831a3529e4de4b383170b187bc76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10e773d-b2ab-4258-9f2f-fe729f8bdd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10e773d-b2ab-4258-9f2f-fe729f8bdd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2659316f-e048-472c-a115-6abc8b623e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2659316f-e048-472c-a115-6abc8b623e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daabe927-95b2-49b9-8242-f7a8cdea8937', 'volume_name': 'volume-daabe927-95b2-49b9-8242-f7a8cdea8937', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607120e4-61af-408d-89bd-a2fda257ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607120e4-61af-408d-89bd-a2fda257ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88648fe-0441-481e-84ed-4be3e4c979a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Volume daabe927-95b2-49b9-8242-f7a8cdea8937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daabe927-95b2-49b9-8242-f7a8cdea8937', 'volume_size': 1} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:13 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:13 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:13 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 1073741824" returned: 0 in 0.473s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:13 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Deleted volume successfully. Jul 16 13:00:13 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 Jul 16 13:00:13 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f83162b5-7c4b-4671-a14a-348ffb5f4de9 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-63be7510-9665-4db1-b2bf-a9bfafad75b8-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:13 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (13a7a761-e81c-47a8-8da2-e2e12cd41bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da92076c-9d52-42a6-a5ee-ad2ad2f0f49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1520345671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabe927-95b2-49b9-8242-f7a8cdea8937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f8a398fe8244f0b5eaac6a16fd327a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='c90831a3529e4de4b383170b187bc76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Creating volume daabe927-95b2-49b9-8242-f7a8cdea8937 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da92076c-9d52-42a6-a5ee-ad2ad2f0f49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1248079108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327392ed-9b10-4655-8dac-bc5acdae2dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 1073741824 Jul 16 13:00:13 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f3ccb-7702-4815-960c-89f4f627695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3f3ccb-7702-4815-960c-89f4f627695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716867e5-b8ec-4600-9dc6-655f395f721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716867e5-b8ec-4600-9dc6-655f395f721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '327392ed-9b10-4655-8dac-bc5acdae2dc5', 'volume_name': 'volume-327392ed-9b10-4655-8dac-bc5acdae2dc5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0ba317-ac8b-4b22-b986-9e5aa8a03b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0ba317-ac8b-4b22-b986-9e5aa8a03b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fe4a42-0802-4162-8203-c7c807bf88e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Volume 327392ed-9b10-4655-8dac-bc5acdae2dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-327392ed-9b10-4655-8dac-bc5acdae2dc5', 'volume_size': 1} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ca0564-fa02-44c2-b1f4-9314d699eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-889a3ad1-59f3-4769-8476-434a066f4ae0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff8bcea-dd7c-42b7-b345-6e07ce1cd0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Volume volume-889a3ad1-59f3-4769-8476-434a066f4ae0 (889a3ad1-59f3-4769-8476-434a066f4ae0): created successfully Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff8bcea-dd7c-42b7-b345-6e07ce1cd0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (6c6e7eca-0c09-4257-92a2-095c85ca2356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-972214ed-3786-48cf-b79e-c65eb362bde4 tempest-VolumesListAdminTestJSON-1172431336 None] Created volume successfully. Jul 16 13:00:13 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 1073741824" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:14 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 Jul 16 13:00:14 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:14 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1248079108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=327392ed-9b10-4655-8dac-bc5acdae2dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:13Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Creating volume 327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:14 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88648fe-0441-481e-84ed-4be3e4c979a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daabe927-95b2-49b9-8242-f7a8cdea8937', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:14 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 1073741824 Jul 16 13:00:14 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae47e34a-f402-4fa8-aa3b-3a66c4150f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Volume volume-daabe927-95b2-49b9-8242-f7a8cdea8937 (daabe927-95b2-49b9-8242-f7a8cdea8937): created successfully Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae47e34a-f402-4fa8-aa3b-3a66c4150f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Flow 'volume_create_manager' (2bd83f23-7c35-446f-aee6-7e49cbdaff72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-12503cc1-66b7-4e7b-8fb3-2c7e35be7530 tempest-VolumesTransfersV357Test-1558034244 None] Created volume successfully. Jul 16 13:00:14 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 1073741824" returned: 0 in 0.439s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:14 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:14 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:14 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fe4a42-0802-4162-8203-c7c807bf88e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-327392ed-9b10-4655-8dac-bc5acdae2dc5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733e5fae-93ed-4332-95a4-f2c245ebc1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Volume volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 (327392ed-9b10-4655-8dac-bc5acdae2dc5): created successfully Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733e5fae-93ed-4332-95a4-f2c245ebc1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (13a7a761-e81c-47a8-8da2-e2e12cd41bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d50b3615-3e2d-459d-99e6-0e7dbac0f838 tempest-VolumesSnapshotTestJSON-269030534 None] Created volume successfully. Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (27797b09-1be3-4585-9d0f-1a15461f317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a051fbd7-cba6-4394-becb-418092e47025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "cinder-daabe927-95b2-49b9-8242-f7a8cdea8937-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a051fbd7-cba6-4394-becb-418092e47025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-710674183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c14603-988c-4def-ad20-4b36457f8336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:15Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae966c1-d827-4856-8f28-bf51af2ce0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae966c1-d827-4856-8f28-bf51af2ce0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3127e11d-5f22-4049-b471-bd9b8b15b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3127e11d-5f22-4049-b471-bd9b8b15b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c14603-988c-4def-ad20-4b36457f8336', 'volume_name': 'volume-f9c14603-988c-4def-ad20-4b36457f8336', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5cb563-465e-4938-9ecc-7aebefbca0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5cb563-465e-4938-9ecc-7aebefbca0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559dd4f2-8b65-4422-916a-17c2fd70618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Volume f9c14603-988c-4def-ad20-4b36457f8336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c14603-988c-4def-ad20-4b36457f8336', 'volume_size': 1} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-710674183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c14603-988c-4def-ad20-4b36457f8336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:15Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Creating volume f9c14603-988c-4def-ad20-4b36457f8336 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-daabe927-95b2-49b9-8242-f7a8cdea8937-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:15 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 1073741824 Jul 16 13:00:15 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "cinder-quobyte-daabe927-95b2-49b9-8242-f7a8cdea8937" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-quobyte-daabe927-95b2-49b9-8242-f7a8cdea8937" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c95ad-5cc2-4ea9-9ee1-c335098e207a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:15 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 Jul 16 13:00:15 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:15 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 1073741824" returned: 0 in 0.547s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:15 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:15 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937 Jul 16 13:00:15 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:15 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 Jul 16 13:00:15 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:16 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-daabe927-95b2-49b9-8242-f7a8cdea8937" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-quobyte-daabe927-95b2-49b9-8242-f7a8cdea8937" released by "delete_volume" :: held 0.764s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:16 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.381s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559dd4f2-8b65-4422-916a-17c2fd70618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c14603-988c-4def-ad20-4b36457f8336', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03204837-09e1-456f-986d-55c7573a0d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Creating offline snapshot 8c105568-90c5-4ddf-9711-26f8ebfb2981 of volume 327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66d81f2-a1ed-401f-9b67-c0f7d434e2bc]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Volume volume-f9c14603-988c-4def-ad20-4b36457f8336 (f9c14603-988c-4def-ad20-4b36457f8336): created successfully Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03204837-09e1-456f-986d-55c7573a0d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (27797b09-1be3-4585-9d0f-1a15461f317b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Created reservations ['c030bda1-e4cc-4fba-b999-4cff5b2b5b24', 'f49a66f4-765b-4d32-8291-14703b750fce', 'bed0b61f-eee7-48c4-8fea-e9f447239981', 'cc1b9879-7ab1-44b6-bc6c-4787661836e5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1832078c-cb2a-44a6-9c77-4a0dd8a675ec tempest-VolumesListAdminTestJSON-1172431336 None] Created volume successfully. Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:16 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:16 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:16 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:16 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:16 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Deleted volume successfully. Jul 16 13:00:16 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab8ea362-582c-481a-bd83-730950417553 tempest-VolumesTransfersV357Test-567681298 None] Lock "cinder-daabe927-95b2-49b9-8242-f7a8cdea8937-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:16 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 1G Jul 16 13:00:16 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:17 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 1G" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:17 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:17 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:17 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:17 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 is being set with open permissions: ugo+rw Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:17 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:17 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:17 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:17 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info Jul 16 13:00:17 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (b0e3d4dd-4438-40b4-8fc4-bf193dec39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c20352-b982-42c2-b6a5-368b9cc048b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c20352-b982-42c2-b6a5-368b9cc048b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1121961504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2ea500-e8b6-493f-b5ff-4f9a9917d923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:18Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50db68d5-bb4f-41e2-a1b5-b7e0a1d9ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50db68d5-bb4f-41e2-a1b5-b7e0a1d9ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4de8d6-559d-4098-971b-f66374c3d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4de8d6-559d-4098-971b-f66374c3d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2ea500-e8b6-493f-b5ff-4f9a9917d923', 'volume_name': 'volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458dbf1a-f6b7-44ec-8088-fd0c739a1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (458dbf1a-f6b7-44ec-8088-fd0c739a1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dead02b-e858-40c5-86e5-30693d344de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Volume ac2ea500-e8b6-493f-b5ff-4f9a9917d923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923', 'volume_size': 1} Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:17 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:17 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info is being set with open permissions: ugo+rw Jul 16 13:00:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:18 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info Jul 16 13:00:18 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:18 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.info" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1121961504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2ea500-e8b6-493f-b5ff-4f9a9917d923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30567a722c247ee9fb7644d775c4080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:18Z,use_quota=True,user_id='6bc6ea941369486a8ed1fb98d1650dbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Creating volume ac2ea500-e8b6-493f-b5ff-4f9a9917d923 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:18 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 1073741824 Jul 16 13:00:18 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e1e2fc00-fe33-490b-9d16-f9a44b07937e tempest-VolumesSnapshotTestJSON-269030534 None] Create snapshot completed successfully Jul 16 13:00:18 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 1073741824" returned: 0 in 0.460s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:18 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 Jul 16 13:00:18 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:19 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dead02b-e858-40c5-86e5-30693d344de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9270b9-0111-4b43-8cfc-ac0ef7a1fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Volume volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 (ac2ea500-e8b6-493f-b5ff-4f9a9917d923): created successfully Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9270b9-0111-4b43-8cfc-ac0ef7a1fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Flow 'volume_create_manager' (b0e3d4dd-4438-40b4-8fc4-bf193dec39b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dc12fd6f-0d31-4690-825f-efba0dd44734 tempest-VolumesListAdminTestJSON-1172431336 None] Created volume successfully. Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (a7b82a9a-24f8-4748-b2bc-b4299caae5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecd776d-9fad-43e4-b8b7-965fba2d5199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecd776d-9fad-43e4-b8b7-965fba2d5199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-281333170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0faa1eaa-65bc-489b-920a-06097e5f4754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c1a5fc95f14bf0b641b3263d1ac440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c105568-90c5-4ddf-9711-26f8ebfb2981,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:20Z,use_quota=True,user_id='b1ba4c0e95ea4ad69730c0fef9f806e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362e65a4-3a6b-4b32-a8d0-eae7521e3da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362e65a4-3a6b-4b32-a8d0-eae7521e3da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00641fb3-a22e-402e-9b70-1b02eff924f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00641fb3-a22e-402e-9b70-1b02eff924f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0faa1eaa-65bc-489b-920a-06097e5f4754', 'volume_name': 'volume-0faa1eaa-65bc-489b-920a-06097e5f4754', 'volume_size': 1, 'snapshot_id': '8c105568-90c5-4ddf-9711-26f8ebfb2981'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c3f3c4-4a8f-4f2b-b7b9-65760128fd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c3f3c4-4a8f-4f2b-b7b9-65760128fd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c1f58-bf19-4beb-a617-920723bb2aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume 0faa1eaa-65bc-489b-920a-06097e5f4754: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0faa1eaa-65bc-489b-920a-06097e5f4754', 'volume_size': 1, 'snapshot_id': '8c105568-90c5-4ddf-9711-26f8ebfb2981'} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981-0faa1eaa-65bc-489b-920a-06097e5f4754" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981-0faa1eaa-65bc-489b-920a-06097e5f4754" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Creating volume 0faa1eaa-65bc-489b-920a-06097e5f4754 from snapshot 8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] snapshot: 8c105568-90c5-4ddf-9711-26f8ebfb2981, volume: 0faa1eaa-65bc-489b-920a-06097e5f4754, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0773099b-98f4-4262-b2d3-1a7ec3c45ee3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:20 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:20 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:20 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327392ed-9b10-4655-8dac-bc5acdae2dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c45f6d-1d56-4185-921c-4b3930238512]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:20 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:20 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:20 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:20 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 Jul 16 13:00:20 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Flow 'volume_create_manager' (6cdb8e32-ae32-42b4-8de5-b6d313c1d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184724c9-d6e0-48eb-8145-8fd3c310efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184724c9-d6e0-48eb-8145-8fd3c310efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f54a75-fc8c-4963-a178-fd5b66cd6840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57bc60b02938458ea2cf828d34228bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:21Z,use_quota=True,user_id='37b96be04824429a9519abf124ebe1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee2c202-de03-4c7a-a5bb-c11827f7a258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee2c202-de03-4c7a-a5bb-c11827f7a258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b3e00a-e659-4701-bf04-44269471f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b3e00a-e659-4701-bf04-44269471f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f54a75-fc8c-4963-a178-fd5b66cd6840', 'volume_name': 'volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094c26dc-9e2d-40e0-af16-00f31101d53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094c26dc-9e2d-40e0-af16-00f31101d53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc5223-186b-43a6-a4db-2206a47df198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Volume b1f54a75-fc8c-4963-a178-fd5b66cd6840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840', 'volume_size': 1} Jul 16 13:00:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Flow 'volume_create_manager' (3d25395f-7a32-4d84-8b08-605816e84ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bda15f-b8fb-4354-8029-83ae679a6d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63bda15f-b8fb-4354-8029-83ae679a6d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2015962420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a7a0ae-27b0-493d-bb4f-27b2b8363900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdfb318ff444ed9beda40c303955936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:26Z,use_quota=True,user_id='f2027bcc67d94404ac3c9dd64ea503b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6f094f-159a-4f84-8a72-d57229ec72c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6f094f-159a-4f84-8a72-d57229ec72c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a426e8-cd9b-47eb-9b6c-d57dbf786d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a426e8-cd9b-47eb-9b6c-d57dbf786d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a7a0ae-27b0-493d-bb4f-27b2b8363900', 'volume_name': 'volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a29fb8-1581-4873-bdae-3b3e06292a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a29fb8-1581-4873-bdae-3b3e06292a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae719dc-759e-4358-8f36-73c9c30f7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Volume 24a7a0ae-27b0-493d-bb4f-27b2b8363900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900', 'volume_size': 1} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:25 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754" returned: 0 in 4.936s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e95ba22-7ce2-4ce3-89f3-bcbb56ad3361]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:25 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:25 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:26 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5, size 1024.00 MB, duration 4.94 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:00:26 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Converted 1024.00 MB image at 207.40 MB/s Jul 16 13:00:26 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 is being set with open permissions: ugo+rw Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:26 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 Jul 16 13:00:26 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:26 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" released by "_copy_volume_from_snapshot" :: held 6.750s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981-0faa1eaa-65bc-489b-920a-06097e5f4754" released by "_create_volume_from_snapshot" :: held 6.782s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.799s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.565s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f54a75-fc8c-4963-a178-fd5b66cd6840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57bc60b02938458ea2cf828d34228bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:21Z,use_quota=True,user_id='37b96be04824429a9519abf124ebe1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Creating volume b1f54a75-fc8c-4963-a178-fd5b66cd6840 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:26 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 1073741824 Jul 16 13:00:26 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82c1f58-bf19-4beb-a617-920723bb2aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0faa1eaa-65bc-489b-920a-06097e5f4754', 'volume_size': 1, 'snapshot_id': '8c105568-90c5-4ddf-9711-26f8ebfb2981'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e8d89-2ea3-41d6-8f99-282860d9a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Volume volume-0faa1eaa-65bc-489b-920a-06097e5f4754 (0faa1eaa-65bc-489b-920a-06097e5f4754): created successfully Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e8d89-2ea3-41d6-8f99-282860d9a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Flow 'volume_create_manager' (a7b82a9a-24f8-4748-b2bc-b4299caae5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-817295f4-2d9b-4765-887c-a135bb8365d6 tempest-VolumesSnapshotTestJSON-269030534 None] Created volume successfully. Jul 16 13:00:27 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 1073741824" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:27 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 Jul 16 13:00:27 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:27 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.545s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2015962420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a7a0ae-27b0-493d-bb4f-27b2b8363900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdfb318ff444ed9beda40c303955936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:26Z,use_quota=True,user_id='f2027bcc67d94404ac3c9dd64ea503b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Creating volume 24a7a0ae-27b0-493d-bb4f-27b2b8363900 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dc5223-186b-43a6-a4db-2206a47df198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:27 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 1073741824 Jul 16 13:00:27 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066ca48e-3919-4811-948b-bc1902f08264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Volume volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 (b1f54a75-fc8c-4963-a178-fd5b66cd6840): created successfully Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066ca48e-3919-4811-948b-bc1902f08264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Flow 'volume_create_manager' (6cdb8e32-ae32-42b4-8de5-b6d313c1d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5dc1f538-d6b4-4401-8625-cd2dc6b4c89b tempest-VolumesListAdminTestJSON-1151502574 None] Created volume successfully. Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-0faa1eaa-65bc-489b-920a-06097e5f4754-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-0faa1eaa-65bc-489b-920a-06097e5f4754-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4e817e-7d04-438d-a28a-72e0180e5dae]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:27 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 Jul 16 13:00:27 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Acquiring lock "cinder-b1f54a75-fc8c-4963-a178-fd5b66cd6840-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "cinder-b1f54a75-fc8c-4963-a178-fd5b66cd6840-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Acquiring lock "cinder-quobyte-b1f54a75-fc8c-4963-a178-fd5b66cd6840" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "cinder-quobyte-b1f54a75-fc8c-4963-a178-fd5b66cd6840" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3a5e7-8549-4eb1-8121-ded7ea8a65a0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:27 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 1073741824" returned: 0 in 0.558s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-ac2ea500-e8b6-493f-b5ff-4f9a9917d923-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-ac2ea500-e8b6-493f-b5ff-4f9a9917d923-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:27 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 Jul 16 13:00:27 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-quobyte-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:27 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 Jul 16 13:00:27 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee54d83-7abd-4ba4-a1d6-62b0b31e1300]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754 Jul 16 13:00:28 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 Jul 16 13:00:28 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae719dc-759e-4358-8f36-73c9c30f7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8e2bcb-34f7-45f5-80e1-2a628aa2d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:28 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Volume volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 (24a7a0ae-27b0-493d-bb4f-27b2b8363900): created successfully Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8e2bcb-34f7-45f5-80e1-2a628aa2d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Flow 'volume_create_manager' (3d25395f-7a32-4d84-8b08-605816e84ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:28 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840 Jul 16 13:00:28 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d97cafd5-05dd-49d3-b06b-3fedaf1bd804 tempest-VolumesNegativeTest-1299648317 None] Created volume successfully. Jul 16 13:00:28 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0faa1eaa-65bc-489b-920a-06097e5f4754" returned: 0 in 0.296s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-0faa1eaa-65bc-489b-920a-06097e5f4754" released by "delete_volume" :: held 0.873s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:28 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['5d0f09ce-4323-48ea-ac89-ace74e29ccbc', 'd4c55b4a-61b7-4b91-bc66-189e24daa27e', '05a07e07-7c33-481a-8df6-9fb3e4ba9c2c', 'ebe79048-5f0a-4a78-9b88-09b9a71714b1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:28 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923 Jul 16 13:00:28 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1f54a75-fc8c-4963-a178-fd5b66cd6840" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:28 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "cinder-quobyte-b1f54a75-fc8c-4963-a178-fd5b66cd6840" released by "delete_volume" :: held 0.765s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Created reservations ['5e7294d7-15bc-4ee5-8446-2101182787a3', 'd9107940-90ce-4c37-b121-9a0951892c5d', '808bd8ca-bc3e-485d-9d7a-2f4ef2d02a2b', '1404e290-9a55-4392-9c0d-77c754e79394'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:28 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-8c105568-90c5-4ddf-9711-26f8ebfb2981-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-8c105568-90c5-4ddf-9711-26f8ebfb2981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:28 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:28 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Deleting offline snapshot 8c105568-90c5-4ddf-9711-26f8ebfb2981 of volume 327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] snapshot_file for this snap is: volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8abbf-f5ea-47d6-8953-85a522a9e3d1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Deleted volume successfully. Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-ac2ea500-e8b6-493f-b5ff-4f9a9917d923" released by "delete_volume" :: held 0.905s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2c76372a-b5fd-41f2-afc9-4d79c263e7a7 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-0faa1eaa-65bc-489b-920a-06097e5f4754-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Created reservations ['80ff53b4-3302-48b8-9451-bcbf963674b8', '5176f3ff-167b-4c7e-b98f-10c04f3bdc56', 'd65563da-4d67-4fc8-8e18-5f6b25aa761d', '8adbd4a9-656e-4095-8f7a-c98e5240452d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:29 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:29 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:29 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:29 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:29 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Deleted volume successfully. Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906bf1da-6d66-474c-a7f4-a46c6c1adc97 tempest-VolumesListAdminTestJSON-1151502574 None] Lock "cinder-b1f54a75-fc8c-4963-a178-fd5b66cd6840-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-f9c14603-988c-4def-ad20-4b36457f8336-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-f9c14603-988c-4def-ad20-4b36457f8336-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-quobyte-f9c14603-988c-4def-ad20-4b36457f8336" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-f9c14603-988c-4def-ad20-4b36457f8336" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9ca564-f1b6-43e8-ae18-ad75d4f2ea83]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:29 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-327392ed-9b10-4655-8dac-bc5acdae2dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:00:29 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093c001-b19f-4194-a430-a218aebfa818]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Deleted volume successfully. Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2db18791-5656-4c96-a404-d5d5c87f9879 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-ac2ea500-e8b6-493f-b5ff-4f9a9917d923-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:29 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 Jul 16 13:00:29 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:29 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:29 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:29 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:29 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:29 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336 Jul 16 13:00:29 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:29 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:29 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:30 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f9c14603-988c-4def-ad20-4b36457f8336" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-f9c14603-988c-4def-ad20-4b36457f8336" released by "delete_volume" :: held 0.783s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Created reservations ['6a869e0b-9736-4659-addc-c5ff7e5eedce', 'cf468ebc-54eb-42f9-a69d-71273f1539fe', '94baf9f1-22d9-4152-b926-f9363555ed92', '91858b3f-00ab-405a-b590-e2e7dc3dcd47'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:30 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:30 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981 Jul 16 13:00:30 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:30 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:30 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:30 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-889a3ad1-59f3-4769-8476-434a066f4ae0-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:30 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5.8c105568-90c5-4ddf-9711-26f8ebfb2981" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Deleted volume successfully. Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-889a3ad1-59f3-4769-8476-434a066f4ae0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-8c105568-90c5-4ddf-9711-26f8ebfb2981" released by "_delete_snapshot" :: held 1.854s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bdc701a3-4d5c-48bd-9f34-5f87a29e9836 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-f9c14603-988c-4def-ad20-4b36457f8336-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" released by "delete_snapshot" :: held 1.882s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "cinder-quobyte-889a3ad1-59f3-4769-8476-434a066f4ae0" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-889a3ad1-59f3-4769-8476-434a066f4ae0" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4183ecd-8109-411a-81e9-9ddf4e5a413b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['fe647ec2-35cf-4ed8-bfda-01d0ac66de30', 'd79480a8-ca2d-4169-8999-d10dc33e3008', '7822f200-8786-47ff-ac11-745a47a5b7b6', 'c92983d1-8cde-4154-91ec-1b36a324e959'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Delete snapshot completed successfully. Jul 16 13:00:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e8597ad-fc9c-41ba-bfd8-e8948cd2e72c tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-8c105568-90c5-4ddf-9711-26f8ebfb2981-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:30 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 Jul 16 13:00:30 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:31 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-327392ed-9b10-4655-8dac-bc5acdae2dc5-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:31 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0 Jul 16 13:00:31 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-327392ed-9b10-4655-8dac-bc5acdae2dc5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4816fe98-d738-4779-acef-1a0595517c50]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:31 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-889a3ad1-59f3-4769-8476-434a066f4ae0" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:31 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:31 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-quobyte-889a3ad1-59f3-4769-8476-434a066f4ae0" released by "delete_volume" :: held 0.911s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Created reservations ['69193983-538c-41ea-bb87-ca2591388fd2', '604e25a0-6661-4645-90e3-df524472fa0b', 'ad1be97d-efb6-4434-86cf-203a458c40b7', 'c6ad19f9-0d99-4346-a6dc-dfa0ad762020'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:31 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:31 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:32 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.558s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:32 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5 Jul 16 13:00:32 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:32 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Deleted volume successfully. Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d462bddc-2ac8-41ef-901c-4bed3107b320 tempest-VolumesListAdminTestJSON-1172431336 None] Lock "cinder-889a3ad1-59f3-4769-8476-434a066f4ae0-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:32 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-327392ed-9b10-4655-8dac-bc5acdae2dc5" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-327392ed-9b10-4655-8dac-bc5acdae2dc5" released by "delete_volume" :: held 0.906s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['614ceaa0-6285-43f7-ab83-304e5ff320f8', '79d15154-ad2a-4927-8a57-6980abb719af', '4819a299-ccd2-4051-afd8-407efc2813ae', 'ce887465-b364-446c-9dc7-7dd998621c74'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:32 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:32 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:32 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Deleted volume successfully. Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ea5e316-a559-4c7d-8345-9641af46e7e5 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-327392ed-9b10-4655-8dac-bc5acdae2dc5-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8debe9c8-24da-4a20-b6d9-6db781b4e339]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:33 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 Jul 16 13:00:33 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:33 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:33 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5 Jul 16 13:00:33 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:33 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-quobyte-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5" released by "delete_volume" :: held 0.762s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Created reservations ['17bcc7b8-50c6-44e1-9cd3-12ff23053c47', 'ad13e09a-25ed-4df1-a9f7-576575b54941', '330e52cf-e271-4fa1-a5dc-d3fbb9ea798d', '02a3fd09-3f07-4e28-81e4-e6c77936313a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:33 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:33 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:34 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Deleted volume successfully. Jul 16 13:00:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60b5c00d-b163-46ce-ab44-07d71cf3ee69 tempest-VolumesSnapshotTestJSON-269030534 None] Lock "cinder-2e0b37ce-b35d-4784-8a71-ddcc4fa6ffe5-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=147,cinder:UPDATE=177,cinder:INSERT=49,cinder:DELETE=19 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=142,cinder:UPDATE=189,cinder:DELETE=14,cinder:INSERT=39 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Flow 'volume_create_manager' (5d18ad61-d10c-4947-91cd-d417b1d8c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b12c4ed-9a3e-4404-a028-886b691e097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b12c4ed-9a3e-4404-a028-886b691e097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1429960781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e242f3-f8fd-45a2-858d-22a250302b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9cac56359641e7b21952943245649c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:44Z,use_quota=True,user_id='8f6874c1c95f4ecf906dee87a8b4905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a8ad92-1e64-401c-8ca4-1af2dbc8d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a8ad92-1e64-401c-8ca4-1af2dbc8d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e6e4e4-63d6-4dff-92ef-c0c590c1911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e6e4e4-63d6-4dff-92ef-c0c590c1911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e242f3-f8fd-45a2-858d-22a250302b05', 'volume_name': 'volume-c4e242f3-f8fd-45a2-858d-22a250302b05', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5bb3f6-0ca1-422b-a6d7-490a7db0ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5bb3f6-0ca1-422b-a6d7-490a7db0ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0f6f4b-2875-4479-b8c3-d8dedb648790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Volume c4e242f3-f8fd-45a2-858d-22a250302b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e242f3-f8fd-45a2-858d-22a250302b05', 'volume_size': 1} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1429960781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e242f3-f8fd-45a2-858d-22a250302b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9cac56359641e7b21952943245649c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:44Z,use_quota=True,user_id='8f6874c1c95f4ecf906dee87a8b4905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Creating volume c4e242f3-f8fd-45a2-858d-22a250302b05 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:43 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 1073741824 Jul 16 13:00:43 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:44 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 1073741824" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:44 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 Jul 16 13:00:44 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:44 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0f6f4b-2875-4479-b8c3-d8dedb648790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e242f3-f8fd-45a2-858d-22a250302b05', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b15edb7-5405-4de8-9f74-25f185e0b99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Volume volume-c4e242f3-f8fd-45a2-858d-22a250302b05 (c4e242f3-f8fd-45a2-858d-22a250302b05): created successfully Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b15edb7-5405-4de8-9f74-25f185e0b99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Flow 'volume_create_manager' (5d18ad61-d10c-4947-91cd-d417b1d8c269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7f6eaeb4-6d08-4108-9e89-5818fdcc2fdf tempest-VolumesTransfersV355Test-1915763073 None] Created volume successfully. Jul 16 13:00:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b6fc5367-2fbf-474f-8d66-aa7556780f7e tempest-VolumesTransfersV355Test-175426130 None] Transfer volume completed successfully. Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "cinder-c4e242f3-f8fd-45a2-858d-22a250302b05-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-c4e242f3-f8fd-45a2-858d-22a250302b05-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "cinder-quobyte-c4e242f3-f8fd-45a2-858d-22a250302b05" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-quobyte-c4e242f3-f8fd-45a2-858d-22a250302b05" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[392d8f88-8d23-4632-bc89-25d09b5565ab]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:47 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 Jul 16 13:00:47 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:47 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05" returned: 0 in 0.485s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:47 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05 Jul 16 13:00:47 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:48 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c4e242f3-f8fd-45a2-858d-22a250302b05" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-quobyte-c4e242f3-f8fd-45a2-858d-22a250302b05" released by "delete_volume" :: held 0.818s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Created reservations ['715655e6-473d-4627-92df-e51c0da7dbe1', 'e2e3d433-d1f2-4636-bbf2-72c3c4593bb8', '4220b2e4-3cf0-4fe6-9e91-64f15e7fd88a', '7220b8be-3f52-4f2c-b436-49b0313de75d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:48 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:48 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:48 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Deleted volume successfully. Jul 16 13:00:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8832c41d-4964-4b8d-a175-f1abd0728158 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-c4e242f3-f8fd-45a2-858d-22a250302b05-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Flow 'volume_create_manager' (aa60c558-6a77-4e37-9fe0-cefe5f19e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c67ff-4da7-4f0c-ac0b-d28ba7aff4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92c67ff-4da7-4f0c-ac0b-d28ba7aff4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1877220297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59cfe95-5e89-4440-bfa9-173422ee936b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9cac56359641e7b21952943245649c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:49Z,use_quota=True,user_id='8f6874c1c95f4ecf906dee87a8b4905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1c2ac5-e525-419b-831a-a1e7110d9d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1c2ac5-e525-419b-831a-a1e7110d9d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b85ae9c-4b6d-4289-89d0-e0d4e721858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b85ae9c-4b6d-4289-89d0-e0d4e721858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd59cfe95-5e89-4440-bfa9-173422ee936b', 'volume_name': 'volume-d59cfe95-5e89-4440-bfa9-173422ee936b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7285c9fe-1a03-4f45-b3a6-24cfd2735582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7285c9fe-1a03-4f45-b3a6-24cfd2735582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e3220e-083f-4cd8-a2c7-dde35f8e486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Volume d59cfe95-5e89-4440-bfa9-173422ee936b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d59cfe95-5e89-4440-bfa9-173422ee936b', 'volume_size': 1} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1877220297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d59cfe95-5e89-4440-bfa9-173422ee936b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9cac56359641e7b21952943245649c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:49Z,use_quota=True,user_id='8f6874c1c95f4ecf906dee87a8b4905d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Creating volume d59cfe95-5e89-4440-bfa9-173422ee936b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:49 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b 1073741824 Jul 16 13:00:49 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:49 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b 1073741824" returned: 0 in 0.597s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:49 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b Jul 16 13:00:49 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:50 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e3220e-083f-4cd8-a2c7-dde35f8e486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d59cfe95-5e89-4440-bfa9-173422ee936b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50a38cb-caec-4fe3-bf05-452892aacc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Volume volume-d59cfe95-5e89-4440-bfa9-173422ee936b (d59cfe95-5e89-4440-bfa9-173422ee936b): created successfully Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50a38cb-caec-4fe3-bf05-452892aacc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Flow 'volume_create_manager' (aa60c558-6a77-4e37-9fe0-cefe5f19e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dd32c87e-b8fc-456c-a3bc-53929baf9ae9 tempest-VolumesTransfersV355Test-1915763073 None] Created volume successfully. Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Acquiring lock "cinder-24a7a0ae-27b0-493d-bb4f-27b2b8363900-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "cinder-24a7a0ae-27b0-493d-bb4f-27b2b8363900-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Acquiring lock "cinder-quobyte-24a7a0ae-27b0-493d-bb4f-27b2b8363900" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "cinder-quobyte-24a7a0ae-27b0-493d-bb4f-27b2b8363900" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[280514a3-a9f7-4ba7-8f99-daab92796bb4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:50 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 Jul 16 13:00:50 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:51 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:51 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900 Jul 16 13:00:51 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:51 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-24a7a0ae-27b0-493d-bb4f-27b2b8363900" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "cinder-quobyte-24a7a0ae-27b0-493d-bb4f-27b2b8363900" released by "delete_volume" :: held 0.677s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Created reservations ['75be7f35-624a-4261-9f1d-6d4c20cfc602', '58e9dd36-ec2d-4015-aecf-0bccc04d1cc3', '74e62a74-42ea-411c-9747-958387286e6d', 'e5aa49a3-a134-4501-817a-2bb92b1253d0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "cinder-d59cfe95-5e89-4440-bfa9-173422ee936b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-d59cfe95-5e89-4440-bfa9-173422ee936b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:51 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:51 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "cinder-quobyte-d59cfe95-5e89-4440-bfa9-173422ee936b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-quobyte-d59cfe95-5e89-4440-bfa9-173422ee936b" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889a6c0-4c74-4f6c-8a83-9891ad3b02c0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:51 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b Jul 16 13:00:51 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:51 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Deleted volume successfully. Jul 16 13:00:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-560353d7-87f1-4786-92ea-2af8f5af8cb0 tempest-VolumesNegativeTest-1299648317 None] Lock "cinder-24a7a0ae-27b0-493d-bb4f-27b2b8363900-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:52 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b" returned: 0 in 0.511s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:52 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b Jul 16 13:00:52 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:52 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d59cfe95-5e89-4440-bfa9-173422ee936b" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-quobyte-d59cfe95-5e89-4440-bfa9-173422ee936b" released by "delete_volume" :: held 0.886s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Created reservations ['8c6ff68b-3d99-44a8-b400-22bd2ed5c4c6', '3b31e462-0ee3-4473-9525-d5099ddefad3', 'c894520b-f4da-4848-96bb-e415a5ea0e8c', 'f86d70bb-689e-4cdf-8e1a-4e227b4b0f31'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:52 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:00:52 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:53 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:53 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:00:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Deleted volume successfully. Jul 16 13:00:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fc15682a-ed88-4084-90d0-591aec484867 tempest-VolumesTransfersV355Test-1542157731 None] Lock "cinder-d59cfe95-5e89-4440-bfa9-173422ee936b-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Flow 'volume_create_manager' (3c86f7c6-3356-4e67-b21b-88bb89630766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e470dc7-9e90-4b91-9fb5-23020c6add4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e470dc7-9e90-4b91-9fb5-23020c6add4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-548796455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21f8d9a-c398-431b-a536-8c90f6e9d8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc128d985314b848dd1384f1b0e4154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:56Z,use_quota=True,user_id='9213bc88b9cc41119172464b030726b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79c44da-e693-4c7a-b41a-353470aa3296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79c44da-e693-4c7a-b41a-353470aa3296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9365c01-e5d5-4b0d-858e-d793b2f5fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9365c01-e5d5-4b0d-858e-d793b2f5fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21f8d9a-c398-431b-a536-8c90f6e9d8aa', 'volume_name': 'volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f5d5c9-13db-438a-bb18-65c3110c49b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f5d5c9-13db-438a-bb18-65c3110c49b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d1469e-4d4f-4386-89c0-94f1e89d5527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa', 'volume_size': 1} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-548796455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21f8d9a-c398-431b-a536-8c90f6e9d8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc128d985314b848dd1384f1b0e4154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:00:56Z,use_quota=True,user_id='9213bc88b9cc41119172464b030726b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Creating volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:00:55 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:00:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:56 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa 1073741824 Jul 16 13:00:56 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:56 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa 1073741824" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:56 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa Jul 16 13:00:56 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:56 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d1469e-4d4f-4386-89c0-94f1e89d5527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec20bce-4e0c-4017-b840-c8eea93332b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:00:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Volume volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa (c21f8d9a-c398-431b-a536-8c90f6e9d8aa): created successfully Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec20bce-4e0c-4017-b840-c8eea93332b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:00:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Flow 'volume_create_manager' (3c86f7c6-3356-4e67-b21b-88bb89630766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:00:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-caa2cb60-94f5-4c00-99a1-822c51d2c142 tempest-VolumesSnapshotListTestJSON-2081193982 None] Created volume successfully. Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Creating offline snapshot 78273088-0590-43b4-8d68-43026f545b50 of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d894aa07-6639-4976-a562-3ab249eaba30]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:58 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa Jul 16 13:00:58 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:58 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:58 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 1G Jul 16 13:00:58 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:59 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 1G" returned: 0 in 0.526s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:59 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:00:59 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:59 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:00:59 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 is being set with open permissions: ugo+rw Jul 16 13:00:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:00:59 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:00:59 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:00:59 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Jul 16 13:00:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:00 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info Jul 16 13:01:00 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Flow 'volume_create_manager' (e0dbbdc6-1cee-40be-b16e-34c0e211e446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178957a3-77a3-400a-b1e0-620171bb80f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178957a3-77a3-400a-b1e0-620171bb80f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2128031681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e61aad-cac2-42f7-87d7-689337a3ba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ee8164a0146c6b6f1f378a78dc0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:00Z,use_quota=True,user_id='6166f81a532c46689467c877798b746b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5258c35-5337-4c23-ab4e-65efc65b998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5258c35-5337-4c23-ab4e-65efc65b998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f66733-2f6c-44a6-a6ba-86299ea160dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:01:00 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:00 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info is being set with open permissions: ugo+rw Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:00 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info Jul 16 13:01:00 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f66733-2f6c-44a6-a6ba-86299ea160dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9e61aad-cac2-42f7-87d7-689337a3ba5b', 'volume_name': 'volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69357003-beeb-4e1f-ad81-4dda970d584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69357003-beeb-4e1f-ad81-4dda970d584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a3b1c2-48c4-463f-bc34-fa9c7d8bdf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Volume d9e61aad-cac2-42f7-87d7-689337a3ba5b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Trying to clone d9e61aad-cac2-42f7-87d7-689337a3ba5b from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:01:00 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.info" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2182c3af-9ea3-49b6-be77-e4bb6d398402 tempest-VolumesSnapshotListTestJSON-2081193982 None] Create snapshot completed successfully Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:01:00 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Image download 20.69 MB at 20.69 MB/s Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[524e4925-4fe5-47bd-85ef-9b06acd284d8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:01 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD Jul 16 13:01:01 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:01 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 is fetched for user 6166f81a532c46689467c877798b746b. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[909dd257-43b3-489e-91c1-667e27407dc5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:01 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD Jul 16 13:01:01 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Creating offline snapshot 28194a6c-f34f-4439-9c4c-ebdbd0b1baae of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:01:01 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b430f34-cd53-482e-8ddf-c7f7006b0f6c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:01 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:01:01 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:02 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:02 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae 1G Jul 16 13:01:02 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:02 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae 1G" returned: 0 in 0.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:02 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:02 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:03 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:03 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae is being set with open permissions: ugo+rw Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:03 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:03 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:03 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.603s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2128031681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e61aad-cac2-42f7-87d7-689337a3ba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ee8164a0146c6b6f1f378a78dc0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:00Z,use_quota=True,user_id='6166f81a532c46689467c877798b746b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Creating volume d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:03 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1073741824 Jul 16 13:01:03 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4c947e5a-3331-4c7a-b866-a81ca8626a41 tempest-VolumesSnapshotListTestJSON-2081193982 None] Create snapshot completed successfully Jul 16 13:01:03 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1073741824" returned: 0 in 0.540s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:04 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b Jul 16 13:01:04 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:04 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.177s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Creating offline snapshot 9e996e10-8046-49b0-bc85-b875b006661e of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Attempting download of 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume d9e61aad-cac2-42f7-87d7-689337a3ba5b. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6decb98e-0091-4fb4-aa68-d613e40997d4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab8740f-b571-494d-823e-4041e449ded1]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:04 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:04 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:04 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b Jul 16 13:01:04 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:04 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.424s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:04 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e 1G Jul 16 13:01:04 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:04 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:05 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b Jul 16 13:01:05 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:05 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b" returned: 1 in 0.520s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_15cyhj1b' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde0286-6bf7-4154-8a95-26b4dc8f700d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:05 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e 1G" returned: 0 in 0.610s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:05 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e Jul 16 13:01:05 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:05 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD Jul 16 13:01:05 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:05 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:05 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e is being set with open permissions: ugo+rw Jul 16 13:01:05 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:01:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:05 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e Jul 16 13:01:05 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:05 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b Jul 16 13:01:05 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:06 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-072125a2-d075-4679-b39f-93e43c333bbe tempest-VolumesSnapshotListTestJSON-2081193982 None] Create snapshot completed successfully Jul 16 13:01:07 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b" returned: 0 in 1.984s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:07 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_pkkwgu1qdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:01:07 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Converted 112.00 MB image at 56.43 MB/s Jul 16 13:01:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:07 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1G Jul 16 13:01:07 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-9e996e10-8046-49b0-bc85-b875b006661e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-9e996e10-8046-49b0-bc85-b875b006661e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-9e996e10-8046-49b0-bc85-b875b006661e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:08 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 1G" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Downloaded image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume d9e61aad-cac2-42f7-87d7-689337a3ba5b successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 for user 6166f81a532c46689467c877798b746b is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Marking volume d9e61aad-cac2-42f7-87d7-689337a3ba5b as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-9e996e10-8046-49b0-bc85-b875b006661e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Deleting offline snapshot 9e996e10-8046-49b0-bc85-b875b006661e of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] snapshot_file for this snap is: volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Copying metadata from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 to d9e61aad-cac2-42f7-87d7-689337a3ba5b. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Creating volume glance metadata for volume d9e61aad-cac2-42f7-87d7-689337a3ba5b backed by image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec45a33-7b31-46d9-aef1-cc4860d6cb13]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a3b1c2-48c4-463f-bc34-fa9c7d8bdf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf0d94f-7194-4af9-93c1-8595eb4c4d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Volume volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b (d9e61aad-cac2-42f7-87d7-689337a3ba5b): created successfully Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf0d94f-7194-4af9-93c1-8595eb4c4d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:08 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e Jul 16 13:01:08 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Flow 'volume_create_manager' (e0dbbdc6-1cee-40be-b16e-34c0e211e446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f7451ef9-d75e-4590-bcde-dc7cdf483874 tempest-VolumesExtendTest-160369206 None] Created volume successfully. Jul 16 13:01:08 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e" returned: 0 in 0.413s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[427db1ad-e6ca-4d04-886f-ed59aacedb53]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:08 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:08 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec0550-9168-4eab-942f-067095c5750d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:08 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:08 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:09 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b Jul 16 13:01:09 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:09 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:01:09 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:09 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e Jul 16 13:01:09 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:09 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b" returned: 0 in 0.434s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Flow 'volume_create_manager' (26b098fd-9655-4600-8bab-a74af2e3aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc33669f-890d-42ef-8db1-c491b2ffe3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b 2G" returned: 0 in 0.131s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.602s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc33669f-890d-42ef-8db1-c491b2ffe3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1438429067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f331d0f-ba96-478f-b578-d7dfc4fc77a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74abf00abb0140d29d7e63ea33e90636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:09Z,use_quota=True,user_id='b0f7b27a9f404a27a31ec922b07c4952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5e06cf-0bd7-4039-8bba-3afe49ec2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5e06cf-0bd7-4039-8bba-3afe49ec2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0539fe1-0bf0-4d90-9f0d-977bff1b5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:01:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-78ecb91e-d66f-41bf-b681-887cdb087027 tempest-VolumesExtendTest-160369206 None] Extend volume completed successfully. Jul 16 13:01:09 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:09 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e Jul 16 13:01:09 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0539fe1-0bf0-4d90-9f0d-977bff1b5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'volume_name': 'volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf1d8b-7607-45d1-a2fe-37603d5bf75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf1d8b-7607-45d1-a2fe-37603d5bf75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f2b92-69b7-41dc-b556-c15c7621e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Trying to clone 0f331d0f-ba96-478f-b578-d7dfc4fc77a7 from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:01:09 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.9e996e10-8046-49b0-bc85-b875b006661e" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-9e996e10-8046-49b0-bc85-b875b006661e" released by "_delete_snapshot" :: held 1.771s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" released by "delete_snapshot" :: held 1.812s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Created reservations ['2b269c4a-8c5c-4fb0-a890-e28f1e1de2d5', '24bcb466-3e56-45aa-958f-5ed04c44d2d7', '0e3c0233-86d5-4576-9506-c4db576d21fe', 'e58675bd-7488-4ec3-832a-046b6ab73433'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-d9e61aad-cac2-42f7-87d7-689337a3ba5b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "cinder-d9e61aad-cac2-42f7-87d7-689337a3ba5b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:01:10 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Image download 20.69 MB at 20.69 MB/s Jul 16 13:01:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Delete snapshot completed successfully. Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-quobyte-d9e61aad-cac2-42f7-87d7-689337a3ba5b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e7265f56-150c-47e2-8aa4-48dbc2b5f3d4 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-9e996e10-8046-49b0-bc85-b875b006661e-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9841eea1-f92a-4a86-94fb-ae43a6e85c4f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-28194a6c-f34f-4439-9c4c-ebdbd0b1baae-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-d9e61aad-cac2-42f7-87d7-689337a3ba5b" acquired by "delete_volume" :: waited 0.054s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-28194a6c-f34f-4439-9c4c-ebdbd0b1baae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[07143744-2a26-4584-8b8c-149eb3dd9657]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-28194a6c-f34f-4439-9c4c-ebdbd0b1baae" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-28194a6c-f34f-4439-9c4c-ebdbd0b1baae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Deleting offline snapshot 28194a6c-f34f-4439-9c4c-ebdbd0b1baae of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:01:10 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD Jul 16 13:01:10 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] snapshot_file for this snap is: volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[722568b0-4478-4907-aa28-0b796d347418]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:10 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b Jul 16 13:01:10 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:10 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:10 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:10 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 is fetched for user b0f7b27a9f404a27a31ec922b07c4952. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6374a6c-3a41-4b9e-8cc0-fef2ec5cb4c3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:10 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:10 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b Jul 16 13:01:10 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:10 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:10 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD Jul 16 13:01:10 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[542bfb9f-9471-4f78-a10b-311b1e796f63]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:01:11 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:11 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9e61aad-cac2-42f7-87d7-689337a3ba5b" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-d9e61aad-cac2-42f7-87d7-689337a3ba5b" released by "delete_volume" :: held 0.716s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:11 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1438429067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f331d0f-ba96-478f-b578-d7dfc4fc77a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74abf00abb0140d29d7e63ea33e90636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:09Z,use_quota=True,user_id='b0f7b27a9f404a27a31ec922b07c4952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Creating volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Created reservations ['e8e0522c-fc98-4b59-8665-224eac13ce64', 'f09bd751-b8db-4699-90d1-e78b31bfb190', '04e0cf27-3632-4e87-8cc7-7f2af4ec79af', '887c88b1-b2ba-456f-8ce8-e8621ea11fad'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:11 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1073741824 Jul 16 13:01:11 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:11 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:11 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:11 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:11 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Deleted volume successfully. Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a1b34c4-0345-4b8a-b783-f1d687eafd08 tempest-VolumesExtendTest-160369206 None] Lock "cinder-d9e61aad-cac2-42f7-87d7-689337a3ba5b-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:11 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1073741824" returned: 0 in 0.548s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 Jul 16 13:01:11 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:11 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:11 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae Jul 16 13:01:11 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:12 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Flow 'volume_create_manager' (3a931c0b-3499-4dc6-b818-057842de6959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3168a26a-e76c-474f-a907-2809cadf1264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3168a26a-e76c-474f-a907-2809cadf1264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-419053774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0501e0d8-c6e1-4c83-a5d5-e86386515834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ee8164a0146c6b6f1f378a78dc0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:12Z,use_quota=True,user_id='6166f81a532c46689467c877798b746b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605ad4d6-5e83-44be-8444-c6bdb2e44326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605ad4d6-5e83-44be-8444-c6bdb2e44326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e09bd9-20e8-4adb-a14a-ea240696a996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e09bd9-20e8-4adb-a14a-ea240696a996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0501e0d8-c6e1-4c83-a5d5-e86386515834', 'volume_name': 'volume-0501e0d8-c6e1-4c83-a5d5-e86386515834', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a7b909-4ca0-4c14-8f28-8e2729d9c6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:12 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a7b909-4ca0-4c14-8f28-8e2729d9c6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e07719-523d-4565-aca9-26e158a30c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Volume 0501e0d8-c6e1-4c83-a5d5-e86386515834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0501e0d8-c6e1-4c83-a5d5-e86386515834', 'volume_size': 1} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-419053774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0501e0d8-c6e1-4c83-a5d5-e86386515834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ee8164a0146c6b6f1f378a78dc0de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:12Z,use_quota=True,user_id='6166f81a532c46689467c877798b746b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Creating volume 0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.28194a6c-f34f-4439-9c4c-ebdbd0b1baae" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 1073741824 Jul 16 13:01:12 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-28194a6c-f34f-4439-9c4c-ebdbd0b1baae" released by "_delete_snapshot" :: held 1.710s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" released by "delete_snapshot" :: held 1.735s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Attempting download of 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeaaf02-72fe-4d99-8da4-c03e2c3f93b0]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Created reservations ['267bdb73-f0a2-425c-bc01-a57556bad860', '5f7a1c95-50ad-4627-9f92-c96311c79257', 'ef9d0359-6350-4ffe-b515-de5d9dc90e66', '70bd72f8-5852-4b7f-ac29-d390f093355b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Delete snapshot completed successfully. Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6325c80e-e928-4d9b-af4a-93ee649080f8 tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-28194a6c-f34f-4439-9c4c-ebdbd0b1baae-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:12 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw Jul 16 13:01:12 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-78273088-0590-43b4-8d68-43026f545b50-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:12 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-78273088-0590-43b4-8d68-43026f545b50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:12 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 1073741824" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-78273088-0590-43b4-8d68-43026f545b50" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-78273088-0590-43b4-8d68-43026f545b50" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Deleting offline snapshot 78273088-0590-43b4-8d68-43026f545b50 of volume c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] snapshot_file for this snap is: volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6581a451-6aec-4fc4-9acc-e2b85133a4ca]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:12 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw Jul 16 13:01:12 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:01:12 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:12 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw" returned: 1 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_awa1opnw' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757f260-8044-4d5d-b969-8f37a04ae714]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:12 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e07719-523d-4565-aca9-26e158a30c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0501e0d8-c6e1-4c83-a5d5-e86386515834', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0aeb0e-4606-4253-9339-c0d61c362c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Volume volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 (0501e0d8-c6e1-4c83-a5d5-e86386515834): created successfully Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0aeb0e-4606-4253-9339-c0d61c362c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Flow 'volume_create_manager' (3a931c0b-3499-4dc6-b818-057842de6959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aabe4f6a-b597-483d-9a29-05462308df5a tempest-VolumesExtendTest-160369206 None] Created volume successfully. Jul 16 13:01:13 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:13 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD Jul 16 13:01:13 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a7a51-0e95-42cd-9cb9-03ca2c5208c0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:13 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa Jul 16 13:01:13 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:13 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:13 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 Jul 16 13:01:13 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:13 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:13 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:01:13 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:13 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:13 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50 Jul 16 13:01:13 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:14 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa.78273088-0590-43b4-8d68-43026f545b50" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-78273088-0590-43b4-8d68-43026f545b50" released by "_delete_snapshot" :: held 1.512s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" released by "delete_snapshot" :: held 1.545s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Created reservations ['f0c90676-4d99-4a0d-9248-44a8f111e7c3', '1de9170c-1663-4706-93b4-1fdc621ce39d', 'fbbb3b72-1e34-435c-ab77-8e50ebffbb8a', '4d15437b-717f-499c-a830-10ad6ef87072'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Delete snapshot completed successfully. Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-76a8b18a-49c7-4d6a-9462-a98ec7e37d9f tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-78273088-0590-43b4-8d68-43026f545b50-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Creating offline snapshot 1258151d-aa4d-427c-8360-bfc8ad9f63f9 of volume 0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab9928-6570-4d17-9204-fea301312630]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:14 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:14 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-c21f8d9a-c398-431b-a536-8c90f6e9d8aa-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:14 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-c21f8d9a-c398-431b-a536-8c90f6e9d8aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:14 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 1G Jul 16 13:01:14 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc324be-abdc-4f42-ac20-1cc32aaaa4d2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" returned: 0 in 1.768s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_gbzzscaqdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:01:15 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Converted 112.00 MB image at 63.28 MB/s Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa Jul 16 13:01:15 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1G Jul 16 13:01:15 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 1G" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 Jul 16 13:01:15 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa Jul 16 13:01:15 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 1G" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Downloaded image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 for user b0f7b27a9f404a27a31ec922b07c4952 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Marking volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Copying metadata from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 to 0f331d0f-ba96-478f-b578-d7dfc4fc77a7. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Creating volume glance metadata for volume 0f331d0f-ba96-478f-b578-d7dfc4fc77a7 backed by image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41f2b92-69b7-41dc-b556-c15c7621e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:15 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852d1269-ea30-4d71-95f3-588dcfa704d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 is being set with open permissions: ugo+rw Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Volume volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 (0f331d0f-ba96-478f-b578-d7dfc4fc77a7): created successfully Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852d1269-ea30-4d71-95f3-588dcfa704d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:15 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Flow 'volume_create_manager' (26b098fd-9655-4600-8bab-a74af2e3aee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:15 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eeadef96-fdc2-42af-bb35-fdaf6094e7b8 tempest-TestShelveInstance-1683081586 None] Created volume successfully. Jul 16 13:01:15 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" returned: 0 in 0.296s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-quobyte-c21f8d9a-c398-431b-a536-8c90f6e9d8aa" released by "delete_volume" :: held 0.750s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Created reservations ['c64023dc-8d85-4fd8-8558-ed69139948d8', '3435666a-ef12-4792-908c-7ec822d171ad', '9c9f9856-2459-4a23-ba3f-526d5a010e79', '9a0da7b9-20f8-418d-91db-5b1c2248ff47'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:15 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:15 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:15 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info Jul 16 13:01:15 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:16 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Deleted volume successfully. Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0862d24b-7f80-48d0-b913-ec239e5feeda tempest-VolumesSnapshotListTestJSON-2081193982 None] Lock "cinder-c21f8d9a-c398-431b-a536-8c90f6e9d8aa-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:16 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:16 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info is being set with open permissions: ugo+rw Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:16 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info Jul 16 13:01:16 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:16 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.info" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.147s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f12c7f10-7529-46aa-9601-85906e03c339 tempest-VolumesExtendTest-160369206 None] Create snapshot completed successfully Jul 16 13:01:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd46496-9145-4947-977a-dcb290666df5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:17 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:17 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:18 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 2G" returned: 0 in 0.173s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.691s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4affa374-dad7-4c92-a781-2662787da438 tempest-VolumesExtendTest-160369206 None] Extend volume completed successfully. Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-a2fef844-1a76-498a-8ce9-d3a74a4c261b req-cd78620a-a08e-4c07-bf74-23b91b330098 tempest-TestShelveInstance-1683081586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-a2fef844-1a76-498a-8ce9-d3a74a4c261b req-cd78620a-a08e-4c07-bf74-23b91b330098 tempest-TestShelveInstance-1683081586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-a2fef844-1a76-498a-8ce9-d3a74a4c261b req-cd78620a-a08e-4c07-bf74-23b91b330098 tempest-TestShelveInstance-1683081586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-a2fef844-1a76-498a-8ce9-d3a74a4c261b req-cd78620a-a08e-4c07-bf74-23b91b330098 tempest-TestShelveInstance-1683081586 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8762abad-e4c2-469e-acdb-975fe0173f71', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-1258151d-aa4d-427c-8360-bfc8ad9f63f9-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-a2fef844-1a76-498a-8ce9-d3a74a4c261b req-cd78620a-a08e-4c07-bf74-23b91b330098 tempest-TestShelveInstance-1683081586 None] attachment_update completed successfully. Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-1258151d-aa4d-427c-8360-bfc8ad9f63f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-quobyte-1258151d-aa4d-427c-8360-bfc8ad9f63f9" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-1258151d-aa4d-427c-8360-bfc8ad9f63f9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Deleting offline snapshot 1258151d-aa4d-427c-8360-bfc8ad9f63f9 of volume 0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] snapshot_file for this snap is: volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e57a3-548e-40df-87d6-8a22d28fd1f7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:19 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 Jul 16 13:01:19 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:19 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9" returned: 0 in 0.501s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0501e0d8-c6e1-4c83-a5d5-e86386515834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410a184-14ae-4a9c-b668-e9348775bb8d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:19 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:19 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:20 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:20 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 Jul 16 13:01:20 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:20 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:20 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9 Jul 16 13:01:20 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:20 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834.1258151d-aa4d-427c-8360-bfc8ad9f63f9" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-1258151d-aa4d-427c-8360-bfc8ad9f63f9" released by "_delete_snapshot" :: held 1.797s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" released by "delete_snapshot" :: held 1.827s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Created reservations ['c4351d28-3087-4195-ae5d-3542e1839bf2', 'f148de52-00a1-4f20-9256-c2902501729e', '33aebeb1-d2aa-4246-8bf3-b08a7e5ee788', '5b843589-29da-40bf-adde-fa328a46f737'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Delete snapshot completed successfully. Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e2020f0e-b266-42ba-9e3d-c9630cf0d128 tempest-VolumesExtendTest-160369206 None] Lock "cinder-1258151d-aa4d-427c-8360-bfc8ad9f63f9-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-0501e0d8-c6e1-4c83-a5d5-e86386515834-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "cinder-0501e0d8-c6e1-4c83-a5d5-e86386515834-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Acquiring lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[91272bea-7158-46d9-8054-e6dae4683287]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:21 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:21 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:21 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:21 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834 Jul 16 13:01:21 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:22 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0501e0d8-c6e1-4c83-a5d5-e86386515834" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "cinder-quobyte-0501e0d8-c6e1-4c83-a5d5-e86386515834" released by "delete_volume" :: held 0.841s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Created reservations ['956334bb-9638-4746-acc5-ad92ae5919d8', '8ee15c87-3061-4a27-96ef-a0786b4e1b12', '0916e85d-b259-4eac-9be5-c976883e3c7c', '1959595b-846d-4459-9c86-48e4fd8dd1fe'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:22 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:22 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:23 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Deleted volume successfully. Jul 16 13:01:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-101670a4-1b05-4a5f-8fff-2b590d0634be tempest-VolumesExtendTest-160369206 None] Lock "cinder-0501e0d8-c6e1-4c83-a5d5-e86386515834-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (9ad5eebc-8815-4114-8ca7-45707aed08e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7739a7d0-d899-4d8e-9ccf-1301ea687211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7739a7d0-d899-4d8e-9ccf-1301ea687211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-289734235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:27Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f1d14-ebcd-4933-afed-fcb916adad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f1d14-ebcd-4933-afed-fcb916adad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f782f60c-75f5-4966-aa59-d97b61e3849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f782f60c-75f5-4966-aa59-d97b61e3849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb', 'volume_name': 'volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540dc06e-cf00-43b8-bb0c-dcd7c57b19bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540dc06e-cf00-43b8-bb0c-dcd7c57b19bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409c8941-2358-4ec1-8b91-939d6ebd8b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Volume dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb', 'volume_size': 1} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-289734235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:27Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Creating volume dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:27 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb 1073741824 Jul 16 13:01:27 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:28 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb 1073741824" returned: 0 in 0.593s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:28 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb Jul 16 13:01:28 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:28 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409c8941-2358-4ec1-8b91-939d6ebd8b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801bcb10-9168-4013-919b-560a90f08455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Volume volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb (dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb): created successfully Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801bcb10-9168-4013-919b-560a90f08455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (9ad5eebc-8815-4114-8ca7-45707aed08e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0a236f77-4592-4867-8b5e-95e72493ed56 tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (705fa97d-9fc3-4120-80f0-c3000704067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b672c4f-64c2-492e-80d4-1a5c0fe304f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b672c4f-64c2-492e-80d4-1a5c0fe304f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1767115007',display_name='tempest-VolumesGetTest-Volume-311436441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62ef902-2ad2-464d-b94c-58d39b5c6677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:31Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d6ffa2-a0ff-4177-83ed-438bdc65d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d6ffa2-a0ff-4177-83ed-438bdc65d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cf8f1a-1969-4ed1-b5cd-b48205c5f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85cf8f1a-1969-4ed1-b5cd-b48205c5f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62ef902-2ad2-464d-b94c-58d39b5c6677', 'volume_name': 'volume-b62ef902-2ad2-464d-b94c-58d39b5c6677', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0add1-4f9c-4893-beb2-a1f144b4429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0add1-4f9c-4893-beb2-a1f144b4429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44355eb6-c98e-4c64-ae82-73d9caee579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Volume b62ef902-2ad2-464d-b94c-58d39b5c6677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62ef902-2ad2-464d-b94c-58d39b5c6677', 'volume_size': 1} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1767115007',display_name='tempest-VolumesGetTest-Volume-311436441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62ef902-2ad2-464d-b94c-58d39b5c6677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:31Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Creating volume b62ef902-2ad2-464d-b94c-58d39b5c6677 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:30 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:30 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 1073741824 Jul 16 13:01:30 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:31 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 1073741824" returned: 0 in 0.603s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:31 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 Jul 16 13:01:31 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:31 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44355eb6-c98e-4c64-ae82-73d9caee579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62ef902-2ad2-464d-b94c-58d39b5c6677', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8cbbdd-860b-49ac-8cea-af3d049fd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Volume volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 (b62ef902-2ad2-464d-b94c-58d39b5c6677): created successfully Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f8cbbdd-860b-49ac-8cea-af3d049fd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (705fa97d-9fc3-4120-80f0-c3000704067a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2df1e764-706b-43f7-b0d8-d43ab82c7675 tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-b62ef902-2ad2-464d-b94c-58d39b5c6677-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "cinder-b62ef902-2ad2-464d-b94c-58d39b5c6677-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-b62ef902-2ad2-464d-b94c-58d39b5c6677" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-b62ef902-2ad2-464d-b94c-58d39b5c6677" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2b1fd-b2dc-410d-bba8-b5074c4452f3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:33 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 Jul 16 13:01:33 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:33 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677" returned: 0 in 0.459s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:33 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677 Jul 16 13:01:33 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:33 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b62ef902-2ad2-464d-b94c-58d39b5c6677" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-b62ef902-2ad2-464d-b94c-58d39b5c6677" released by "delete_volume" :: held 0.769s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Created reservations ['58e27406-8ae9-4539-9898-f75c87010f69', 'ed3c8b49-6f68-4473-a046-0c58ae3831af', '3cdac1c6-c817-4217-94f7-7f7097f977d4', '8945b2c0-d696-4d9b-8d9d-6cb3319d6562'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:34 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:34 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:34 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d8c8e25-f545-4831-b58d-c809784010d8 tempest-VolumesGetTest-195919379 None] Lock "cinder-b62ef902-2ad2-464d-b94c-58d39b5c6677-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "cinder-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c8f1a8-b691-42d3-a544-53424160aeb8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:34 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb Jul 16 13:01:34 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:34 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:34 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb Jul 16 13:01:34 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:35 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb" released by "delete_volume" :: held 0.899s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Created reservations ['a91edf53-6fb1-4d9d-820b-3db3497d5cef', '10f5878f-1511-425d-b381-bb7c5fc18bd0', 'e3a5f1d9-f100-4447-aaf5-461ab912d5f9', '4e0c3807-666b-4a53-918d-ae9685eab327'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:35 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:35 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:35 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:01:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-866bcf70-3724-48ee-9c5e-26a1d45488cb tempest-VolumesGetTest-195919379 None] Lock "cinder-dcff87aa-66c0-4fc1-9c31-e0f60ed7d1eb-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (fb39a16a-fc86-4dad-a160-41cd2be51ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3388ab-e8ed-472c-8dd8-43af8a6d01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff3388ab-e8ed-472c-8dd8-43af8a6d01b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-167784983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ca232e-91f6-4d40-82b8-6d4c0282e21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:36Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2039305e-aef3-46fc-9edd-e7bd9fb7756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2039305e-aef3-46fc-9edd-e7bd9fb7756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef1fc6b-2711-44f2-a8a7-2c08289dcc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef1fc6b-2711-44f2-a8a7-2c08289dcc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'volume_name': 'volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ad6c5-a76f-46c8-9446-a899026fad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39ad6c5-a76f-46c8-9446-a899026fad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3303489d-9881-443a-ba0f-fa521da5b82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Volume c1ca232e-91f6-4d40-82b8-6d4c0282e21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'volume_size': 1} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-167784983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ca232e-91f6-4d40-82b8-6d4c0282e21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:36Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Creating volume c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:36 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a 1073741824 Jul 16 13:01:36 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:36 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a 1073741824" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:36 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:36 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:37 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3303489d-9881-443a-ba0f-fa521da5b82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f73e7ba-6ac6-4f5a-a941-7b021aac7ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Volume volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a (c1ca232e-91f6-4d40-82b8-6d4c0282e21a): created successfully Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f73e7ba-6ac6-4f5a-a941-7b021aac7ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (fb39a16a-fc86-4dad-a160-41cd2be51ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cb05164e-e0cd-4504-8bd3-49aae1e34865 tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (3b495e42-5826-486e-aa5a-bffbe36aa35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c20b3ec-8c37-42e6-b6a7-42f6fd69f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c20b3ec-8c37-42e6-b6a7-42f6fd69f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1683111204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14e85a7-f730-42c5-8ab4-83a448e1f612,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c1ca232e-91f6-4d40-82b8-6d4c0282e21a,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:39Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95336cdb-112c-42c5-8bbb-a86871240153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95336cdb-112c-42c5-8bbb-a86871240153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeb9a27-26d7-4143-a0c1-3beff0b6f823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edeb9a27-26d7-4143-a0c1-3beff0b6f823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f14e85a7-f730-42c5-8ab4-83a448e1f612', 'volume_name': 'volume-f14e85a7-f730-42c5-8ab4-83a448e1f612', 'volume_size': 1, 'source_volid': 'c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbccb67-98cf-47ca-aae8-c9648159e78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbccb67-98cf-47ca-aae8-c9648159e78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce362f8-63fb-403f-aac9-c16cfe569cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Volume f14e85a7-f730-42c5-8ab4-83a448e1f612: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f14e85a7-f730-42c5-8ab4-83a448e1f612', 'volume_size': 1, 'source_volid': 'c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'source_volstatus': 'available'} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Cloning volume c1ca232e-91f6-4d40-82b8-6d4c0282e21a to volume f14e85a7-f730-42c5-8ab4-83a448e1f612 Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Creating offline snapshot 95b78769-475c-424e-b308-30ee2288d773 of volume c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1220b12-f2e8-4613-b2bc-27367974279d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:39 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:39 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:39 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:39 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 1G Jul 16 13:01:39 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:40 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 1G" returned: 0 in 0.523s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:40 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:40 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:40 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:40 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 is being set with open permissions: ugo+rw Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:40 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:40 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:40 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:40 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info Jul 16 13:01:40 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:41 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info is being set with open permissions: ugo+rw Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:41 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info Jul 16 13:01:41 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:41 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.info" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] snapshot: 95b78769-475c-424e-b308-30ee2288d773, volume: f14e85a7-f730-42c5-8ab4-83a448e1f612, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c97e2fb-546a-4f0c-9f49-1546a154e4f6]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:41 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:41 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:42 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4189e1-4e07-4e0a-8562-e9948ded9788]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:42 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:42 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:42 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:01:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:42 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 Jul 16 13:01:42 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:47 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612" returned: 0 in 4.920s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541a643-52b6-40fe-b84a-4fffd4e928ea]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:47 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:47 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:48 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.636s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:01:48 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Converted 1024.00 MB image at 208.06 MB/s Jul 16 13:01:48 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 is being set with open permissions: ugo+rw Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:48 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 Jul 16 13:01:48 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:48 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" released by "_copy_volume_from_snapshot" :: held 6.721s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=129,cinder:SELECT=119,cinder:DELETE=18,cinder:INSERT=43 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-95b78769-475c-424e-b308-30ee2288d773" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-95b78769-475c-424e-b308-30ee2288d773" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Deleting offline snapshot 95b78769-475c-424e-b308-30ee2288d773 of volume c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] snapshot_file for this snap is: volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c6bf9-0f7d-468b-baa6-9d98fabbe859]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:48 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:48 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:48 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[602f6965-d9fc-4255-91c9-1a3eea1608fa]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:49 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:49 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:49 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:49 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:49 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:49 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:49 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773 Jul 16 13:01:49 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:50 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a.95b78769-475c-424e-b308-30ee2288d773" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-95b78769-475c-424e-b308-30ee2288d773" released by "_delete_snapshot" :: held 1.751s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=119,cinder:INSERT=44,cinder:UPDATE=128,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.176s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce362f8-63fb-403f-aac9-c16cfe569cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14e85a7-f730-42c5-8ab4-83a448e1f612', 'volume_size': 1, 'source_volid': 'c1ca232e-91f6-4d40-82b8-6d4c0282e21a', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddb60c-7162-4916-ad38-2ac2b10c395f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Volume volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 (f14e85a7-f730-42c5-8ab4-83a448e1f612): created successfully Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ddb60c-7162-4916-ad38-2ac2b10c395f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (3b495e42-5826-486e-aa5a-bffbe36aa35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2e2420b3-0c37-419b-b144-eb4ef86017f3 tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (829b9e03-ef17-4879-a059-6664c7161fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eadc69a-c893-4b35-9737-0ab89ba1a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eadc69a-c893-4b35-9737-0ab89ba1a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-747641631',display_name='tempest-VolumesGetTest-Volume-1367582263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e803cd1-82fd-4a8a-aae3-ba86cb2341e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:52Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511cf571-4dbe-4315-b6a7-65be2a2f1a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511cf571-4dbe-4315-b6a7-65be2a2f1a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f271f-14aa-4c2d-aa48-8622d92a12ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3f271f-14aa-4c2d-aa48-8622d92a12ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e803cd1-82fd-4a8a-aae3-ba86cb2341e1', 'volume_name': 'volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef02fd-c02d-4849-9496-a8d32605693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbef02fd-c02d-4849-9496-a8d32605693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3165e-b3b5-44f0-a1dd-9ba3be940aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Volume 5e803cd1-82fd-4a8a-aae3-ba86cb2341e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1', 'volume_size': 1} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:01:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-747641631',display_name='tempest-VolumesGetTest-Volume-1367582263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e803cd1-82fd-4a8a-aae3-ba86cb2341e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:01:52Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Creating volume 5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:01:51 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:01:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:52 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 1073741824 Jul 16 13:01:52 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:52 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 1073741824" returned: 0 in 0.486s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:52 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 Jul 16 13:01:52 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:52 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a3165e-b3b5-44f0-a1dd-9ba3be940aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb592e-5d51-4629-86b8-b76882549174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:01:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Volume volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 (5e803cd1-82fd-4a8a-aae3-ba86cb2341e1): created successfully Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ecb592e-5d51-4629-86b8-b76882549174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:01:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (829b9e03-ef17-4879-a059-6664c7161fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:01:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7ac8ac9-0ac0-4ecc-bbc0-642c1d934a9c tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:01:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-70e51e53-c14e-462b-8868-81537c717403 req-8cfb1a74-3e68-495e-b1bf-b29a5c301397 tempest-TestShelveInstance-1683081586 None] Terminate volume connection completed successfully. Jul 16 13:01:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-70e51e53-c14e-462b-8868-81537c717403 req-8cfb1a74-3e68-495e-b1bf-b29a5c301397 tempest-TestShelveInstance-1683081586 None] Deleting attachment 8762abad-e4c2-469e-acdb-975fe0173f71. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "cinder-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[72af6de7-069b-4828-85a1-2b25b946111b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:54 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 Jul 16 13:01:54 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:54 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:54 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1 Jul 16 13:01:54 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:54 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1" released by "delete_volume" :: held 0.718s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Created reservations ['ed7eec4b-adc1-4b98-80d4-a3fae2f63c46', 'b0863025-c8e2-48c6-b51a-a6dead9e29b4', '6221967b-696b-4b09-a69e-099fcd8c2e50', '06575d81-e509-4716-a21a-db9a6cd6ddb2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:55 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:55 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:55 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-f14e85a7-f730-42c5-8ab4-83a448e1f612-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1f09c49b-2e70-4f6b-8efd-c9c858cec81a tempest-VolumesGetTest-195919379 None] Lock "cinder-5e803cd1-82fd-4a8a-aae3-ba86cb2341e1-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "cinder-f14e85a7-f730-42c5-8ab4-83a448e1f612-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9835e8-2713-4bed-aa4c-46649f5bef66]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:55 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 Jul 16 13:01:55 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:56 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612" returned: 0 in 0.587s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:56 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612 Jul 16 13:01:56 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:56 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f14e85a7-f730-42c5-8ab4-83a448e1f612" returned: 0 in 0.486s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-f14e85a7-f730-42c5-8ab4-83a448e1f612" released by "delete_volume" :: held 1.144s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Created reservations ['8f6341f9-d2fd-4fd0-b296-cbafae166995', '1a440781-2927-4053-bae7-e51a95ebba85', '9cab1469-db8b-41db-9c08-ae0239e887fc', '8e525d46-eb13-48ce-b40c-0c095f36b2dc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:57 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:57 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:57 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7db18df-064e-4472-af20-3b02adef399f tempest-VolumesGetTest-195919379 None] Lock "cinder-f14e85a7-f730-42c5-8ab4-83a448e1f612-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bdf54482-fe96-4b02-9d13-ab44aa75e47c req-4eac2bdf-afb7-4549-9997-9ce7947a4a9f tempest-TestShelveInstance-1683081586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bdf54482-fe96-4b02-9d13-ab44aa75e47c req-4eac2bdf-afb7-4549-9997-9ce7947a4a9f tempest-TestShelveInstance-1683081586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bdf54482-fe96-4b02-9d13-ab44aa75e47c req-4eac2bdf-afb7-4549-9997-9ce7947a4a9f tempest-TestShelveInstance-1683081586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bdf54482-fe96-4b02-9d13-ab44aa75e47c req-4eac2bdf-afb7-4549-9997-9ce7947a4a9f tempest-TestShelveInstance-1683081586 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc04a6d2-29e7-4099-a769-153d015949bc', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:01:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bdf54482-fe96-4b02-9d13-ab44aa75e47c req-4eac2bdf-afb7-4549-9997-9ce7947a4a9f tempest-TestShelveInstance-1683081586 None] attachment_update completed successfully. Jul 16 13:01:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-c1ca232e-91f6-4d40-82b8-6d4c0282e21a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "cinder-c1ca232e-91f6-4d40-82b8-6d4c0282e21a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e2ddcf-bc27-40f9-b1d2-b888e47fd61d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:58 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:58 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:58 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.527s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:58 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a Jul 16 13:01:58 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:59 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-c1ca232e-91f6-4d40-82b8-6d4c0282e21a" released by "delete_volume" :: held 0.939s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Created reservations ['cebc1681-8bab-4360-8bfa-4412625d1780', 'b8189fe3-310b-4ebd-abb7-4b726565fa0e', 'ff982bc7-2619-487b-8b57-c389ace5dc0f', '8f3d727d-f805-4043-bca4-dcb1a9d4106e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:01:59 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:01:59 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:01:59 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:01:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:01:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0e0e08-31a8-451e-8ecd-51841c36da76 tempest-VolumesGetTest-195919379 None] Lock "cinder-c1ca232e-91f6-4d40-82b8-6d4c0282e21a-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (ac0e0181-005a-4958-abdb-7eccb5345e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b1cd35-9d50-46ad-aeee-5212bd5d3edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b1cd35-9d50-46ad-aeee-5212bd5d3edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1150567491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff84315d-0799-4860-b8d5-9dd7f2c3b4f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:01Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3669f1a5-1df4-48b5-8bae-84e50cd93efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3669f1a5-1df4-48b5-8bae-84e50cd93efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cc8248-2052-4bc9-b5e5-d8567df61312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cc8248-2052-4bc9-b5e5-d8567df61312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff84315d-0799-4860-b8d5-9dd7f2c3b4f6', 'volume_name': 'volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3f56af-426d-40b7-a41c-0e26a23dd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3f56af-426d-40b7-a41c-0e26a23dd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9965e7-d0c2-4cba-b38f-862bbb846c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 16 13:02:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Trying to clone ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:02:02 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:02:02 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Image download 20.69 MB at 20.69 MB/s Jul 16 13:02:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367eadd-cf60-487c-83c2-be340c1e96f0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:02 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD Jul 16 13:02:02 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:03 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:03 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 is fetched for user dd1bca312a634be7b833b7b0d813cdcc. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:02:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59543e6-6709-4c25-ad8d-88c65c5fe4c3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:03 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD Jul 16 13:02:03 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:04 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Flow 'volume_create_manager' (c1fa1db5-bc94-49d4-9c9e-00e94d92626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f377fb-d6eb-4092-a6ba-0b6167c2eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1150567491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff84315d-0799-4860-b8d5-9dd7f2c3b4f6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:01Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Creating volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:04 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f377fb-d6eb-4092-a6ba-0b6167c2eaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-178499608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b16da264044b20b1eebd5d61e97d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:04Z,use_quota=True,user_id='3c17119b65ea4f3bab6a7c9752a1d285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77fc0ad-ac1d-47cd-80d3-95c2c27eba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:04 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1073741824 Jul 16 13:02:04 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77fc0ad-ac1d-47cd-80d3-95c2c27eba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d067bb-579c-4f6b-b7fc-b189bdab0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d067bb-579c-4f6b-b7fc-b189bdab0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7', 'volume_name': 'volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae6b16-f7d2-48ca-8462-df5c5498a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ae6b16-f7d2-48ca-8462-df5c5498a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acbf71e-a254-4182-af61-c87f8d85772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Volume 5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7', 'volume_size': 1} Jul 16 13:02:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:05 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1073741824" returned: 0 in 0.662s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:05 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 Jul 16 13:02:05 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:05 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-178499608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b16da264044b20b1eebd5d61e97d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:04Z,use_quota=True,user_id='3c17119b65ea4f3bab6a7c9752a1d285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Creating volume 5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Attempting download of 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:02:05 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 1073741824 Jul 16 13:02:05 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ad040-43f0-4098-857f-b10dc5932aa7]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:06 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn Jul 16 13:02:06 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:06 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 1073741824" returned: 0 in 0.537s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:06 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 Jul 16 13:02:06 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:06 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn" returned: 0 in 0.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:06 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn Jul 16 13:02:06 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:06 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acbf71e-a254-4182-af61-c87f8d85772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca516691-5f88-4e31-9b74-cb1f5ad09f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Volume volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 (5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7): created successfully Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca516691-5f88-4e31-9b74-cb1f5ad09f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Flow 'volume_create_manager' (c1fa1db5-bc94-49d4-9c9e-00e94d92626c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-21a75906-d965-4e58-84ab-550a983fb0e3 tempest-TestMinimumBasicScenario-13256141 None] Created volume successfully. Jul 16 13:02:06 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn" returned: 1 in 0.539s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_d47koggn' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b0809-1ead-4377-9442-ac9a2805fc09]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:07 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD Jul 16 13:02:07 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:07 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:07 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:02:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:07 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 Jul 16 13:02:07 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:08 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:08 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:09 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.478s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2d8e9409-73f1-451c-8afb-9ea15f77acd5 req-760031d7-6b16-4fb7-98fe-76e078480b32 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2d8e9409-73f1-451c-8afb-9ea15f77acd5 req-760031d7-6b16-4fb7-98fe-76e078480b32 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2d8e9409-73f1-451c-8afb-9ea15f77acd5 req-760031d7-6b16-4fb7-98fe-76e078480b32 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-2d8e9409-73f1-451c-8afb-9ea15f77acd5 req-760031d7-6b16-4fb7-98fe-76e078480b32 tempest-TestMinimumBasicScenario-13256141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73b039ac-5c37-4704-9800-2fe615e487ad', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:02:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-2d8e9409-73f1-451c-8afb-9ea15f77acd5 req-760031d7-6b16-4fb7-98fe-76e078480b32 tempest-TestMinimumBasicScenario-13256141 None] attachment_update completed successfully. Jul 16 13:02:09 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" returned: 0 in 2.440s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7e905d1b-7ace-4a7c-8bea-4e2c8851bc47_en09g45cdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:02:09 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Converted 112.00 MB image at 45.89 MB/s Jul 16 13:02:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:09 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1G Jul 16 13:02:09 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:10 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 1G" returned: 0 in 0.553s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Downloaded image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 ((None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}])) to volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Temporary image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 for user dd1bca312a634be7b833b7b0d813cdcc is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Marking volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Copying metadata from image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 to ff84315d-0799-4860-b8d5-9dd7f2c3b4f6. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Creating volume glance metadata for volume ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 backed by image 7e905d1b-7ace-4a7c-8bea-4e2c8851bc47 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9965e7-d0c2-4cba-b38f-862bbb846c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6', 'volume_size': 1, 'image_id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b355ca4f5fc247b680029a617080bdbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7e905d1b-7ace-4a7c-8bea-4e2c8851bc47', 'created_at': datetime.datetime(2026, 7, 16, 10, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 10, 43, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7e905d1b-7ace-4a7c-8bea-4e2c8851bc47/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372369dd-5ec4-4b06-b8b2-5dfbd1842cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Volume volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 (ff84315d-0799-4860-b8d5-9dd7f2c3b4f6): created successfully Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372369dd-5ec4-4b06-b8b2-5dfbd1842cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (ac0e0181-005a-4958-abdb-7eccb5345e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30fb3e46-0f7b-4005-8854-1305bbab936d tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (bd4d1312-3880-4f5c-ba9c-22cdc7e8161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152557ac-1609-4f1f-8fbf-6496fb36112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152557ac-1609-4f1f-8fbf-6496fb36112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1744396747',display_name='tempest-VolumesGetTest-Volume-351006160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29d6d19-ad50-4edf-abb9-5dcbc2fced13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:13Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a51c9-4c6f-45b3-b9ed-b0dbc32d42ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092a51c9-4c6f-45b3-b9ed-b0dbc32d42ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86abc855-7b39-4162-ae79-d99dca31a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86abc855-7b39-4162-ae79-d99dca31a086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29d6d19-ad50-4edf-abb9-5dcbc2fced13', 'volume_name': 'volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502b4e4e-7eeb-491f-8e4f-7aa56170f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (502b4e4e-7eeb-491f-8e4f-7aa56170f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e0f240-5207-45ac-95a6-b7c8158433ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Volume b29d6d19-ad50-4edf-abb9-5dcbc2fced13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13', 'volume_size': 1} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1744396747',display_name='tempest-VolumesGetTest-Volume-351006160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29d6d19-ad50-4edf-abb9-5dcbc2fced13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf3f53cfd1446639e4adeb28b81fb4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:13Z,use_quota=True,user_id='dd1bca312a634be7b833b7b0d813cdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Creating volume b29d6d19-ad50-4edf-abb9-5dcbc2fced13 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:12 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 1073741824 Jul 16 13:02:12 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:13 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 1073741824" returned: 0 in 0.505s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:13 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 Jul 16 13:02:13 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:13 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e0f240-5207-45ac-95a6-b7c8158433ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e59f3b-404f-483d-97a7-9d167e878463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Volume volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 (b29d6d19-ad50-4edf-abb9-5dcbc2fced13): created successfully Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e59f3b-404f-483d-97a7-9d167e878463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Flow 'volume_create_manager' (bd4d1312-3880-4f5c-ba9c-22cdc7e8161f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f6500c8b-75a6-4c71-81c3-4f61efac0812 tempest-VolumesGetTest-195919379 None] Created volume successfully. Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-b29d6d19-ad50-4edf-abb9-5dcbc2fced13-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "cinder-b29d6d19-ad50-4edf-abb9-5dcbc2fced13-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[435c689a-7339-4f7c-8cb9-db768b1dbc47]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:15 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 Jul 16 13:02:15 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:15 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" returned: 0 in 0.635s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:15 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13 Jul 16 13:02:15 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:16 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-b29d6d19-ad50-4edf-abb9-5dcbc2fced13" released by "delete_volume" :: held 1.163s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Created reservations ['07334e0a-515d-4bd8-8176-f54aee57259f', '75daf381-ef8b-472c-b667-06d7082273de', '7ab5a93a-d96e-496d-b3b6-49933308813d', 'bc9de3c8-72df-4616-94eb-84e91b239d72'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:16 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:16 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:16 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:02:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-214cc161-afad-4653-9a26-b0d3548f50af tempest-VolumesGetTest-195919379 None] Lock "cinder-b29d6d19-ad50-4edf-abb9-5dcbc2fced13-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "cinder-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Acquiring lock "cinder-quobyte-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e348cb0-11d0-4c04-92bb-4da5c7391ad5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:17 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 Jul 16 13:02:17 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:18 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:18 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6 Jul 16 13:02:18 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:18 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "cinder-quobyte-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6" released by "delete_volume" :: held 0.743s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Created reservations ['83cd289a-a6af-4594-a5e6-64f7cb6b4079', '02b0d604-4138-42ea-8b87-c00fc4b239f8', '6d732cd2-d57d-4f9a-bda6-ed1ddd09f691', '2b0f7bed-9242-46cd-a634-9d36958c0717'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:18 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:18 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:18 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Deleted volume successfully. Jul 16 13:02:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cb0daeac-b820-423c-86d7-86b6ef11cd5d tempest-VolumesGetTest-195919379 None] Lock "cinder-ff84315d-0799-4860-b8d5-9dd7f2c3b4f6-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (56fdd274-7cf8-4639-8653-f522933cb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055a76e2-8fe9-4ff8-bf86-1bbff01c939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (055a76e2-8fe9-4ff8-bf86-1bbff01c939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1625117657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:22Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c7d1f5-196a-4f9e-8914-d4e6e6ec5044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c7d1f5-196a-4f9e-8914-d4e6e6ec5044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c278b6ee-e8a0-42bf-973b-a27dccd00e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c278b6ee-e8a0-42bf-973b-a27dccd00e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad', 'volume_name': 'volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb67550b-eb27-4fb3-8ff4-432ae439d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb67550b-eb27-4fb3-8ff4-432ae439d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e64e9b-c7e8-4fd2-a70f-0733476b5c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Volume 776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad', 'volume_size': 1} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1625117657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:22Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Creating volume 776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:21 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:21 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad 1073741824 Jul 16 13:02:21 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:22 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad 1073741824" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:22 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad Jul 16 13:02:22 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:22 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e64e9b-c7e8-4fd2-a70f-0733476b5c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26323df5-e983-4976-80f5-2dc8c8815cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Volume volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad (776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad): created successfully Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26323df5-e983-4976-80f5-2dc8c8815cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (56fdd274-7cf8-4639-8653-f522933cb292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-59f26632-3a33-4367-9a6e-5946072556a7 tempest-VolumesListTestJSON-1973658934 None] Created volume successfully. Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (2f90216e-f5ee-4476-8879-f14cf34696f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c14443a-74c5-4586-8eb4-b52bf42dd23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c14443a-74c5-4586-8eb4-b52bf42dd23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1438118496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:23Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07245c8-28e8-4261-af58-0c54679b2905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07245c8-28e8-4261-af58-0c54679b2905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41192687-543a-4523-807a-c715cea3e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41192687-543a-4523-807a-c715cea3e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31', 'volume_name': 'volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bec364-cac5-4f00-8ad2-872ed05ca683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bec364-cac5-4f00-8ad2-872ed05ca683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1593f8e6-8938-42fa-9bac-8fc15c9ec7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Volume 0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31', 'volume_size': 1} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1438118496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:23Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Creating volume 0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:23 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 1073741824 Jul 16 13:02:23 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:23 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 1073741824" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:23 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 Jul 16 13:02:23 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:24 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1593f8e6-8938-42fa-9bac-8fc15c9ec7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27b08b7-e22f-4325-8395-a4ce875f552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Volume volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 (0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31): created successfully Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27b08b7-e22f-4325-8395-a4ce875f552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (2f90216e-f5ee-4476-8879-f14cf34696f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-adf40fc1-f219-4e96-8b85-8f54f54510be tempest-VolumesListTestJSON-1973658934 None] Created volume successfully. Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (1b65f0db-c911-46c2-a19d-8d3d700dc2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693058e1-afb0-4cec-893d-872a7f1f5d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693058e1-afb0-4cec-893d-872a7f1f5d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-216556156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11eca5d-b7d7-434c-bacb-6c693da79f09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:25Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d04f045-4108-4daf-b518-ee4ad55fcca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d04f045-4108-4daf-b518-ee4ad55fcca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76a76c-892a-4cd0-915a-fbd343117b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a76a76c-892a-4cd0-915a-fbd343117b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11eca5d-b7d7-434c-bacb-6c693da79f09', 'volume_name': 'volume-e11eca5d-b7d7-434c-bacb-6c693da79f09', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f380bf01-c0ec-4d1e-af5c-a4145e65321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f380bf01-c0ec-4d1e-af5c-a4145e65321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36e8fa4-d662-431e-9fca-a7e5ad09055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Volume e11eca5d-b7d7-434c-bacb-6c693da79f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11eca5d-b7d7-434c-bacb-6c693da79f09', 'volume_size': 1} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-216556156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11eca5d-b7d7-434c-bacb-6c693da79f09,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c13855a12d6a454d8de8d25a2783ce40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:02:25Z,use_quota=True,user_id='dfae540ff1ac45fbb9ce1a31be2d07f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Creating volume e11eca5d-b7d7-434c-bacb-6c693da79f09 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:24 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 1073741824 Jul 16 13:02:24 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:25 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 1073741824" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:25 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 Jul 16 13:02:25 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:25 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c36e8fa4-d662-431e-9fca-a7e5ad09055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11eca5d-b7d7-434c-bacb-6c693da79f09', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657ab2e-938e-4925-87ed-a5ac751bf49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Volume volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 (e11eca5d-b7d7-434c-bacb-6c693da79f09): created successfully Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b657ab2e-938e-4925-87ed-a5ac751bf49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Flow 'volume_create_manager' (1b65f0db-c911-46c2-a19d-8d3d700dc2cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-84137746-89c5-460a-8d7d-eaee9ca51d69 tempest-VolumesListTestJSON-1973658934 None] Created volume successfully. Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-e11eca5d-b7d7-434c-bacb-6c693da79f09-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-e11eca5d-b7d7-434c-bacb-6c693da79f09-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-quobyte-e11eca5d-b7d7-434c-bacb-6c693da79f09" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-e11eca5d-b7d7-434c-bacb-6c693da79f09" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0427aa2-b604-43c4-b0ba-581a42019fda]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:28 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 Jul 16 13:02:28 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:28 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:28 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09 Jul 16 13:02:28 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:28 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e11eca5d-b7d7-434c-bacb-6c693da79f09" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-e11eca5d-b7d7-434c-bacb-6c693da79f09" released by "delete_volume" :: held 0.678s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Created reservations ['42628fea-dc0a-4712-b557-1d03264a2690', 'ee5b4b11-0bef-45e1-a6a0-b22099cfd67f', 'db39a96d-35a8-4929-a566-6b52461a25f9', '16dc26ff-ac23-4e90-99d9-dcc10f25661b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:28 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:28 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:28 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Deleted volume successfully. Jul 16 13:02:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-056ce8ab-a56d-48bd-992a-ce5fa4af6b77 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-e11eca5d-b7d7-434c-bacb-6c693da79f09-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-quobyte-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93e667d-aaca-4111-a454-fdef13f71d09]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:29 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 Jul 16 13:02:29 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:29 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:29 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31 Jul 16 13:02:29 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:29 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31" released by "delete_volume" :: held 0.683s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Created reservations ['c70184ec-2001-4dc1-bdda-307058fe3d2b', '3da7db00-1f1e-464c-a461-3ea86ccc32fb', 'd5f3ec65-7128-485e-a1b6-34cbf2d172f5', '8341dc5a-6f46-415e-8ae5-a29489511f05'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:29 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:29 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:30 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Deleted volume successfully. Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e748fc5-6d95-4dd0-a33f-0c9767f7c319 tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-0cd52e04-a02b-40a5-9ea8-3fcd5b8f5e31-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "cinder-quobyte-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb9863-765e-4f5b-bec4-57fed50489c7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:30 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad Jul 16 13:02:30 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:30 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:30 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad Jul 16 13:02:30 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:30 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-quobyte-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad" released by "delete_volume" :: held 0.659s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Created reservations ['20b7d5a3-99da-4c11-9670-368b760b96fe', '3b3d6aa2-acae-44ce-8b03-2c0398800b38', '75451c8d-2424-4e6b-8961-714c9ae674d6', 'ce8be181-7396-4480-a1aa-7bcb7245578e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:31 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:31 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:31 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Deleted volume successfully. Jul 16 13:02:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-505f657b-c46a-4027-b53c-7a26431f043b tempest-VolumesListTestJSON-1973658934 None] Lock "cinder-776598f4-2a0c-4cda-98cd-c0cbb2e4d8ad-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:41 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=90,cinder:SELECT=77,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:02:41 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=96,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:02:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-4bab98bf-7dd1-48fe-9eeb-4f4a23bde159 tempest-TestShelveInstance-1683081586 None] Terminate volume connection completed successfully. Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-4bab98bf-7dd1-48fe-9eeb-4f4a23bde159 tempest-TestShelveInstance-1683081586 None] Deleting attachment cc04a6d2-29e7-4099-a769-153d015949bc. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Acquiring lock "cinder-0f331d0f-ba96-478f-b578-d7dfc4fc77a7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "cinder-0f331d0f-ba96-478f-b578-d7dfc4fc77a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Acquiring lock "cinder-quobyte-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "cinder-quobyte-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[932cb06b-54f3-40fc-83ac-03620d21c23a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:02:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:46 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 Jul 16 13:02:46 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:47 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:47 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7 Jul 16 13:02:47 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:47 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "cinder-quobyte-0f331d0f-ba96-478f-b578-d7dfc4fc77a7" released by "delete_volume" :: held 0.730s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.quota [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Created reservations ['985fd6a1-f969-449f-8548-0458399b7403', '62ba0931-8b02-4597-a050-13a286943465', '3c09d01d-9179-493e-9410-da455baede20', 'cd1688e7-4875-40ee-b3d7-abdd605737b5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:47 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:02:47 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:02:47 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.manager [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:02:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Deleted volume successfully. Jul 16 13:02:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-9b4ab047-acb4-4f91-a4e3-d6473e85f2cd req-07bce576-b4f5-4cd6-b513-487a395d0924 tempest-TestShelveInstance-1683081586 None] Lock "cinder-0f331d0f-ba96-478f-b578-d7dfc4fc77a7-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:02:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:02:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:02:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-a1a94fd8-92ca-4ed1-8277-93228b76b03b req-35f4d9d0-42af-4072-aa05-66eb258e6a33 tempest-TestMinimumBasicScenario-13256141 None] Terminate volume connection completed successfully. Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-a1a94fd8-92ca-4ed1-8277-93228b76b03b req-35f4d9d0-42af-4072-aa05-66eb258e6a33 tempest-TestMinimumBasicScenario-13256141 None] Deleting attachment 73b039ac-5c37-4704-9800-2fe615e487ad. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (7b00a215-6353-4a52-8687-3ac7b2ffa0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87a4ca-c6ff-46b7-85a6-01590cd7a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87a4ca-c6ff-46b7-85a6-01590cd7a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1327138441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9dc75c-5397-4ea2-893b-d008e96ba0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:00Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a34141ed-2cd4-4f15-810c-5125a53a064e),volume_type_id=a34141ed-2cd4-4f15-810c-5125a53a064e)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c567af3-1246-4f54-b808-88988f277090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c567af3-1246-4f54-b808-88988f277090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7ebad5-45e8-4d4d-b996-d1a0811efad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7ebad5-45e8-4d4d-b996-d1a0811efad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9dc75c-5397-4ea2-893b-d008e96ba0ae', 'volume_name': 'volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715519e9-f8b2-4cdc-ac9d-94029479b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715519e9-f8b2-4cdc-ac9d-94029479b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991b32f7-e2f7-4081-906d-7156cf51f2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:02:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume 6d9dc75c-5397-4ea2-893b-d008e96ba0ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae', 'volume_size': 1} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1327138441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9dc75c-5397-4ea2-893b-d008e96ba0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:00Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a34141ed-2cd4-4f15-810c-5125a53a064e),volume_type_id=a34141ed-2cd4-4f15-810c-5125a53a064e)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Creating volume 6d9dc75c-5397-4ea2-893b-d008e96ba0ae {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:02:59 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:02:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:02:59 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae 1073741824 Jul 16 13:02:59 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "cinder-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "cinder-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "cinder-quobyte-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "cinder-quobyte-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[37af167f-6037-48dd-9047-8df91882d182]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (8d44a2ca-eded-4ba4-94b0-437ec43e8b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afa67d1-9703-4d97-a6f3-9452732a1b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afa67d1-9703-4d97-a6f3-9452732a1b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2119086120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fea8dc-94a8-4567-ab77-b89b0b7779d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:00Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06d9f26f-ec22-4bee-b1dd-c4db1cc94f44),volume_type_id=06d9f26f-ec22-4bee-b1dd-c4db1cc94f44)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb8b45d-4f4d-4a40-9f18-9ce30147ce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb8b45d-4f4d-4a40-9f18-9ce30147ce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086477ba-7605-4ae6-9898-dd486d276de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086477ba-7605-4ae6-9898-dd486d276de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1fea8dc-94a8-4567-ab77-b89b0b7779d6', 'volume_name': 'volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da1cc80-0904-48af-96fb-34e4a1d671de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da1cc80-0904-48af-96fb-34e4a1d671de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d48e0-c58a-4849-976a-a82bc778860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume b1fea8dc-94a8-4567-ab77-b89b0b7779d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6', 'volume_size': 1} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:00 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 Jul 16 13:03:00 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:00 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae 1073741824" returned: 0 in 0.738s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:00 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae Jul 16 13:03:00 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:00 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" returned: 0 in 0.525s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:00 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7 Jul 16 13:03:00 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:00 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" returned: 0 in 0.370s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2119086120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fea8dc-94a8-4567-ab77-b89b0b7779d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:00Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06d9f26f-ec22-4bee-b1dd-c4db1cc94f44),volume_type_id=06d9f26f-ec22-4bee-b1dd-c4db1cc94f44)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Creating volume b1fea8dc-94a8-4567-ab77-b89b0b7779d6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991b32f7-e2f7-4081-906d-7156cf51f2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:00 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 1073741824 Jul 16 13:03:00 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62695d5-4801-441d-994b-8e01d70a86d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae (6d9dc75c-5397-4ea2-893b-d008e96ba0ae): created successfully Jul 16 13:03:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c62695d5-4801-441d-994b-8e01d70a86d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (7b00a215-6353-4a52-8687-3ac7b2ffa0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (4c3fe7d2-a34a-4a99-adf4-ae39ed5f928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c2cb39-1f70-44f6-8fbe-696bd0af9964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c2cb39-1f70-44f6-8fbe-696bd0af9964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-906255518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12be652a-cbd0-413b-832d-c36ece29ca37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:01Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b16e853-4653-4900-9846-396be6299fd9),volume_type_id=9b16e853-4653-4900-9846-396be6299fd9)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235c89d-998d-418d-93d4-b6e479802169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6235c89d-998d-418d-93d4-b6e479802169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14771469-475b-4ab9-bcde-1ee03cd61f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:03:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-00f67481-7727-433f-a1d1-1f0d5e197ed3 tempest-TestInstancesWithCinderVolumes-1868483909 None] Created volume successfully. Jul 16 13:03:01 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "cinder-quobyte-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7" released by "delete_volume" :: held 0.976s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Created reservations ['45fa48f9-424c-4559-a3d8-2676be0ba03e', '2786fe4e-064a-491e-883f-3716b141a801', '1bb93bf0-60f1-4db3-b4c5-9bc8855881e5', 'fed035fa-4742-4c51-ab0c-a83553899130'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:01 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:01 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:01 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 1073741824" returned: 0 in 0.662s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:01 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 Jul 16 13:03:01 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:01 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14771469-475b-4ab9-bcde-1ee03cd61f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12be652a-cbd0-413b-832d-c36ece29ca37', 'volume_name': 'volume-12be652a-cbd0-413b-832d-c36ece29ca37', 'volume_size': 1, 'image_id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--855552541', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb83627b57b14e09904abd0e1800a816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'created_at': datetime.datetime(2026, 7, 16, 11, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 2, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4d97842-e79a-419f-a5f3-73197f7ed421/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90383c61-8cab-4225-bba5-faf2bdab7923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90383c61-8cab-4225-bba5-faf2bdab7923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05897ee-f16f-423f-a989-745235f108f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume 12be652a-cbd0-413b-832d-c36ece29ca37: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12be652a-cbd0-413b-832d-c36ece29ca37', 'volume_size': 1, 'image_id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--855552541', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb83627b57b14e09904abd0e1800a816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'created_at': datetime.datetime(2026, 7, 16, 11, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 2, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4d97842-e79a-419f-a5f3-73197f7ed421/file', 'properties': {}}, 'image_service': } Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Trying to clone 12be652a-cbd0-413b-832d-c36ece29ca37 from image a4d97842-e79a-419f-a5f3-73197f7ed421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:03:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Deleted volume successfully. Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-09e62248-0198-4acd-bbf8-ab03a494b4e6 tempest-TestMinimumBasicScenario-13256141 None] Lock "cinder-5d5ab6db-1ba8-4fb5-b0ff-9c1a8572cfb7-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:01 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b7d48e0-c58a-4849-976a-a82bc778860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6aad7d-c4c7-4f22-afe0-4905cce58de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 (b1fea8dc-94a8-4567-ab77-b89b0b7779d6): created successfully Jul 16 13:03:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6aad7d-c4c7-4f22-afe0-4905cce58de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (8d44a2ca-eded-4ba4-94b0-437ec43e8b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f3743d78-7201-4f18-9035-018ca1d27f2a tempest-TestInstancesWithCinderVolumes-1868483909 None] Created volume successfully. Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (daa96343-7dc9-460c-b1e1-fd0d83773776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eca534f-d2e3-4955-bd7f-4640752ed520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eca534f-d2e3-4955-bd7f-4640752ed520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398105268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836533d-10c8-4046-9352-d7a3b6eabbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:04Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fc0c83-8754-48df-bae4-63aac0d7a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fc0c83-8754-48df-bae4-63aac0d7a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd877fef-a1a4-456b-aab9-6b280f127ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd877fef-a1a4-456b-aab9-6b280f127ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6836533d-10c8-4046-9352-d7a3b6eabbf6', 'volume_name': 'volume-6836533d-10c8-4046-9352-d7a3b6eabbf6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36fcdde-180a-4a53-bb6b-f17fe82fe74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36fcdde-180a-4a53-bb6b-f17fe82fe74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553f4e27-48de-4b6a-96a3-58caf2bc464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume 6836533d-10c8-4046-9352-d7a3b6eabbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6836533d-10c8-4046-9352-d7a3b6eabbf6', 'volume_size': 1} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-398105268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6836533d-10c8-4046-9352-d7a3b6eabbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:04Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume 6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:03 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 1073741824 Jul 16 13:03:03 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:04 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 1073741824" returned: 0 in 0.585s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:04 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 Jul 16 13:03:04 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:04 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553f4e27-48de-4b6a-96a3-58caf2bc464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6836533d-10c8-4046-9352-d7a3b6eabbf6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e83312-9215-4f80-a5d2-5958bf20013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 (6836533d-10c8-4046-9352-d7a3b6eabbf6): created successfully Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e83312-9215-4f80-a5d2-5958bf20013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (daa96343-7dc9-460c-b1e1-fd0d83773776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76186328-70b4-44d7-80d6-8efe62de15ba tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:05 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD, size 20.69 MB, duration 4.17 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:03:05 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Image download 20.69 MB at 4.96 MB/s Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae194c3-8434-4408-9e58-a7fbe4e2041f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating offline snapshot a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 of volume 6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[398cc06f-095b-4656-a6ec-d474d1668db6]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:06 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD Jul 16 13:03:06 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:06 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 Jul 16 13:03:06 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:06 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Temporary image a4d97842-e79a-419f-a5f3-73197f7ed421 is fetched for user 3e8290b22b1d40f4842409e5088f72b0. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef36cc1-74e8-4b2c-b0cb-57e2d27d74bd]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:06 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:06 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 1G Jul 16 13:03:06 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:06 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD Jul 16 13:03:06 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:06 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 1G" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:07 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:07 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 Jul 16 13:03:07 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:07 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 is being set with open permissions: ugo+rw Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:07 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 Jul 16 13:03:07 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:07 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:07 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info Jul 16 13:03:07 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:07 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info is being set with open permissions: ugo+rw Jul 16 13:03:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:07 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info Jul 16 13:03:07 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:08 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.info" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-906255518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12be652a-cbd0-413b-832d-c36ece29ca37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb83627b57b14e09904abd0e1800a816',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:01Z,use_quota=True,user_id='3e8290b22b1d40f4842409e5088f72b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b16e853-4653-4900-9846-396be6299fd9),volume_type_id=9b16e853-4653-4900-9846-396be6299fd9)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Creating volume 12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:08 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:08 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1073741824 Jul 16 13:03:08 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef642800-43b2-4025-a3a0-aac2a8f74641 tempest-CreateVolumesFromSnapshotTest-27894975 None] Create snapshot completed successfully Jul 16 13:03:08 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1073741824" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:08 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 Jul 16 13:03:08 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:08 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:08 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:09 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:09 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Attempting download of a4d97842-e79a-419f-a5f3-73197f7ed421 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}])) to volume 12be652a-cbd0-413b-832d-c36ece29ca37. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7def2-84fb-41af-b097-e69ba1c78751]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:09 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1 Jul 16 13:03:09 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:09 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:09 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1 Jul 16 13:03:09 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (4c0cc809-5690-441a-9fed-3c42900fe96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93db1df0-6646-43c1-b01f-23570eec0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93db1df0-6646-43c1-b01f-23570eec0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143129683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:10Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46e0dc0-4c72-435f-824e-5bcb1b13761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d46e0dc0-4c72-435f-824e-5bcb1b13761a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea92375f-ea42-44d2-b4fa-1a0763a7dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea92375f-ea42-44d2-b4fa-1a0763a7dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c', 'volume_name': 'volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0385ccb-2d1f-49f8-a50d-2343aeab60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0385ccb-2d1f-49f8-a50d-2343aeab60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735e6e9-0aa4-4be4-a049-ead2f243c30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c', 'volume_size': 1} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143129683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:10Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:09 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c 1073741824 Jul 16 13:03:09 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:10 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1" returned: 1 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4d97842-e79a-419f-a5f3-73197f7ed421_9ij9f9f1' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d3cd12-05c4-414f-9c21-c4076d782f35]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:10 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD Jul 16 13:03:10 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (79b5f1a4-1511-49b6-b3a8-f804f758dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2233562-d851-4c5a-98fc-84a35f5453fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2233562-d851-4c5a-98fc-84a35f5453fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-164670480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7104ea6-54b3-4406-a7ec-f5d05167cd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:10Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbecd9ae-fcf5-4f8e-bfe9-9a332872a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbecd9ae-fcf5-4f8e-bfe9-9a332872a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622d6463-2230-478d-b7fa-603511993afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622d6463-2230-478d-b7fa-603511993afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7104ea6-54b3-4406-a7ec-f5d05167cd86', 'volume_name': 'volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f28cdd-72b7-42f8-b5fa-1a7253823857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f28cdd-72b7-42f8-b5fa-1a7253823857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3eacfd-854b-4fc9-a627-4e1c8ec261f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume a7104ea6-54b3-4406-a7ec-f5d05167cd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86', 'volume_size': 1} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:10 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c 1073741824" returned: 0 in 0.608s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:10 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:10 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c Jul 16 13:03:10 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] a4d97842-e79a-419f-a5f3-73197f7ed421 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:10 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 Jul 16 13:03:10 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (aaed170e-e626-43b6-9b4b-18c120075204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a973ba-2fe2-4c3b-8d4d-ccb022444712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a973ba-2fe2-4c3b-8d4d-ccb022444712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016372475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea1d596-d260-465e-bc42-b4377f98a79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:11Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec13745e-9a6a-4d22-beef-85140a60689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec13745e-9a6a-4d22-beef-85140a60689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cfcef9-7ce7-46ea-a0ce-02c348a6b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cfcef9-7ce7-46ea-a0ce-02c348a6b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea1d596-d260-465e-bc42-b4377f98a79d', 'volume_name': 'volume-4ea1d596-d260-465e-bc42-b4377f98a79d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949865c2-6af3-4cab-a458-171e0c3d110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949865c2-6af3-4cab-a458-171e0c3d110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a883a7-914f-40ea-9ad0-ca45098bbc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume 4ea1d596-d260-465e-bc42-b4377f98a79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea1d596-d260-465e-bc42-b4377f98a79d', 'volume_size': 1} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:10 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-164670480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7104ea6-54b3-4406-a7ec-f5d05167cd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:10Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume a7104ea6-54b3-4406-a7ec-f5d05167cd86 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:10 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:10 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 1073741824 Jul 16 13:03:10 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a735e6e9-0aa4-4be4-a049-ead2f243c30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4490fb-e49c-4851-8510-e6cc2f2f9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c (cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c): created successfully Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4490fb-e49c-4851-8510-e6cc2f2f9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (4c0cc809-5690-441a-9fed-3c42900fe96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0655df44-4e43-48f2-b5bf-8aaae81cd7ab tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (a71c74d5-8d40-4c3d-a106-74ce843e5960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce4606-5c50-4bf6-bfd3-d4db96153a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ce4606-5c50-4bf6-bfd3-d4db96153a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349778245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117ffd48-c7b1-4461-94fa-98cf3b28494d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:11Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a497f4c1-9d8d-40e5-94b0-620618ed0211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a497f4c1-9d8d-40e5-94b0-620618ed0211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c05cf-5f7e-421d-ad1b-8c92b1a5fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (513c05cf-5f7e-421d-ad1b-8c92b1a5fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117ffd48-c7b1-4461-94fa-98cf3b28494d', 'volume_name': 'volume-117ffd48-c7b1-4461-94fa-98cf3b28494d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02caa6a4-167d-49ab-b6d7-def3388daa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02caa6a4-167d-49ab-b6d7-def3388daa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ef5ad1-0f46-4b2c-84bd-4aeb024fd798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume 117ffd48-c7b1-4461-94fa-98cf3b28494d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117ffd48-c7b1-4461-94fa-98cf3b28494d', 'volume_size': 1} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:11 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 1073741824" returned: 0 in 0.633s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:11 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 Jul 16 13:03:11 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (942d6e26-a709-4278-8349-d83bf21c60ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2597a1-3b10-4b19-bdc9-c1cd1a7fb1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2597a1-3b10-4b19-bdc9-c1cd1a7fb1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-299975761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c6e7b9-b1e3-4c9b-8b39-b66d237ab233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:12Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342414fc-6363-4f49-9729-ca64c252b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342414fc-6363-4f49-9729-ca64c252b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c84b85-3258-4019-b5c5-3fc9f6c35b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c84b85-3258-4019-b5c5-3fc9f6c35b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c6e7b9-b1e3-4c9b-8b39-b66d237ab233', 'volume_name': 'volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1156726b-a5d6-4936-a9f6-f24d145bfdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1156726b-a5d6-4936-a9f6-f24d145bfdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf6f31-0c5d-462f-afc7-283cd74488f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume 09c6e7b9-b1e3-4c9b-8b39-b66d237ab233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233', 'volume_size': 1} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:11 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.064s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016372475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea1d596-d260-465e-bc42-b4377f98a79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:11Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume 4ea1d596-d260-465e-bc42-b4377f98a79d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3eacfd-854b-4fc9-a627-4e1c8ec261f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:11 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d 1073741824 Jul 16 13:03:11 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d665df3c-2dc5-4584-a614-b7c0b57c7e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 (a7104ea6-54b3-4406-a7ec-f5d05167cd86): created successfully Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d665df3c-2dc5-4584-a614-b7c0b57c7e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (79b5f1a4-1511-49b6-b3a8-f804f758dd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c4b7569-b76d-4942-a44c-e8f010cf6560 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:12 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d 1073741824" returned: 0 in 0.578s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:12 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d Jul 16 13:03:12 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:12 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.638s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1349778245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117ffd48-c7b1-4461-94fa-98cf3b28494d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:11Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume 117ffd48-c7b1-4461-94fa-98cf3b28494d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:12 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d 1073741824 Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a883a7-914f-40ea-9ad0-ca45098bbc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea1d596-d260-465e-bc42-b4377f98a79d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:12 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6981370c-07b8-4ead-8e42-b2f1c2db0aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-4ea1d596-d260-465e-bc42-b4377f98a79d (4ea1d596-d260-465e-bc42-b4377f98a79d): created successfully Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6981370c-07b8-4ead-8e42-b2f1c2db0aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (aaed170e-e626-43b6-9b4b-18c120075204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9f0c51e5-1c83-476e-a69e-156e2c0358a2 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:13 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37" returned: 0 in 2.450s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4d97842-e79a-419f-a5f3-73197f7ed421_hp44zmvfdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Converted 112.00 MB image at 45.69 MB/s Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:13 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1G Jul 16 13:03:13 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:13 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d 1073741824" returned: 0 in 0.521s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:13 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 1G" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Downloaded image a4d97842-e79a-419f-a5f3-73197f7ed421 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}])) to volume 12be652a-cbd0-413b-832d-c36ece29ca37 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Temporary image a4d97842-e79a-419f-a5f3-73197f7ed421 for user 3e8290b22b1d40f4842409e5088f72b0 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Marking volume 12be652a-cbd0-413b-832d-c36ece29ca37 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:03:13 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d Jul 16 13:03:13 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Copying metadata from image a4d97842-e79a-419f-a5f3-73197f7ed421 to 12be652a-cbd0-413b-832d-c36ece29ca37. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Creating volume glance metadata for volume 12be652a-cbd0-413b-832d-c36ece29ca37 backed by image a4d97842-e79a-419f-a5f3-73197f7ed421 with: {'image_id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'image_name': 'tempest-scenario-img--855552541', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05897ee-f16f-423f-a989-745235f108f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12be652a-cbd0-413b-832d-c36ece29ca37', 'volume_size': 1, 'image_id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4d97842-e79a-419f-a5f3-73197f7ed421', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--855552541', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bb83627b57b14e09904abd0e1800a816', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a4d97842-e79a-419f-a5f3-73197f7ed421', 'created_at': datetime.datetime(2026, 7, 16, 11, 2, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 2, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4d97842-e79a-419f-a5f3-73197f7ed421/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00005012-2aaa-4f2f-8ecc-a6e05756f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Volume volume-12be652a-cbd0-413b-832d-c36ece29ca37 (12be652a-cbd0-413b-832d-c36ece29ca37): created successfully Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00005012-2aaa-4f2f-8ecc-a6e05756f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Flow 'volume_create_manager' (4c3fe7d2-a34a-4a99-adf4-ae39ed5f928f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-99e26286-8d74-4bc0-9f77-17abd8db5f49 tempest-TestInstancesWithCinderVolumes-1868483909 None] Created volume successfully. Jul 16 13:03:13 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-299975761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c6e7b9-b1e3-4c9b-8b39-b66d237ab233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33e5363be08485690a723d9d1589ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:12Z,use_quota=True,user_id='d453774f81494577a74309cb888ec985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Creating volume 09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ef5ad1-0f46-4b2c-84bd-4aeb024fd798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117ffd48-c7b1-4461-94fa-98cf3b28494d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:13 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 1073741824 Jul 16 13:03:13 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f57ec4a-eb06-4b53-b384-7d4a1b004ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-117ffd48-c7b1-4461-94fa-98cf3b28494d (117ffd48-c7b1-4461-94fa-98cf3b28494d): created successfully Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f57ec4a-eb06-4b53-b384-7d4a1b004ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (a71c74d5-8d40-4c3d-a106-74ce843e5960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-88747a50-8f54-43f2-96c0-572ffd00eff8 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:14 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 1073741824" returned: 0 in 0.622s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:14 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 Jul 16 13:03:14 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:14 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf6f31-0c5d-462f-afc7-283cd74488f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2584f768-4ae0-4a8d-9813-d519788f7bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Volume volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 (09c6e7b9-b1e3-4c9b-8b39-b66d237ab233): created successfully Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2584f768-4ae0-4a8d-9813-d519788f7bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Flow 'volume_create_manager' (942d6e26-a709-4278-8349-d83bf21c60ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a41a628d-77b3-4e21-b6dc-2a2f7d90d53e tempest-CreateVolumesFromSnapshotTest-27894975 None] Created volume successfully. Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2e57c4-f44e-489e-9109-b45db3a54592]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:15 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 Jul 16 13:03:15 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:15 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" returned: 0 in 0.501s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:15 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233 Jul 16 13:03:15 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:16 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233" released by "delete_volume" :: held 0.860s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['5078b89b-4164-4ec4-8e58-f676aaf5579d', 'f0ff45b8-5c3e-4205-b20f-c22b64ba097c', '31c91e21-4e2c-4dbc-aeb4-c956e9b50113', 'd32a2e64-aa69-490e-a36a-9679ec05a395'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:16 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:16 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-117ffd48-c7b1-4461-94fa-98cf3b28494d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-117ffd48-c7b1-4461-94fa-98cf3b28494d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-117ffd48-c7b1-4461-94fa-98cf3b28494d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-117ffd48-c7b1-4461-94fa-98cf3b28494d" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[333f66c6-afb9-44de-ba2a-a741464eba57]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:16 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92eeb06d-7752-4306-a5e2-4b3d36d77c74 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-09c6e7b9-b1e3-4c9b-8b39-b66d237ab233-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:16 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d Jul 16 13:03:16 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:17 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:17 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d Jul 16 13:03:17 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:17 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-117ffd48-c7b1-4461-94fa-98cf3b28494d" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-117ffd48-c7b1-4461-94fa-98cf3b28494d" released by "delete_volume" :: held 0.839s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['d05be779-761e-462d-8c07-d287d0c24f63', '6cbdc167-8006-45fc-a0c8-2bff20a89a26', '4d609ca9-f17c-4f2d-a5bb-e2e2b43fcfb6', '5ca25eaf-4a08-4143-a240-bc31e583cc54'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:17 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:17 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-4ea1d596-d260-465e-bc42-b4377f98a79d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-4ea1d596-d260-465e-bc42-b4377f98a79d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-4ea1d596-d260-465e-bc42-b4377f98a79d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-4ea1d596-d260-465e-bc42-b4377f98a79d" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52badfc-377b-4186-97ac-ab1b4c8037ef]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:18 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4cd68b60-b1c7-4475-a8a2-b683b6d11d61 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-117ffd48-c7b1-4461-94fa-98cf3b28494d-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:18 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d Jul 16 13:03:18 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8d793bf5-3fbe-43ac-ac92-2cfa3e640a6c req-f1a210c5-bad3-4f63-a89e-f1b72ed5255d tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8d793bf5-3fbe-43ac-ac92-2cfa3e640a6c req-f1a210c5-bad3-4f63-a89e-f1b72ed5255d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8d793bf5-3fbe-43ac-ac92-2cfa3e640a6c req-f1a210c5-bad3-4f63-a89e-f1b72ed5255d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-8d793bf5-3fbe-43ac-ac92-2cfa3e640a6c req-f1a210c5-bad3-4f63-a89e-f1b72ed5255d tempest-TestInstancesWithCinderVolumes-1868483909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-12be652a-cbd0-413b-832d-c36ece29ca37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bf8122c-4f22-4175-b924-c7cfde817597', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:03:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8d793bf5-3fbe-43ac-ac92-2cfa3e640a6c req-f1a210c5-bad3-4f63-a89e-f1b72ed5255d tempest-TestInstancesWithCinderVolumes-1868483909 None] attachment_update completed successfully. Jul 16 13:03:18 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d" returned: 0 in 0.497s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:18 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d Jul 16 13:03:18 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:19 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4ea1d596-d260-465e-bc42-b4377f98a79d" returned: 0 in 0.460s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-4ea1d596-d260-465e-bc42-b4377f98a79d" released by "delete_volume" :: held 1.067s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['2dfaafd0-e980-49aa-8fcc-0b4206945268', 'e7714372-2390-4b14-9835-f8fcfa100bcf', 'b241a4a1-44d0-4195-9f23-889864bb71ee', 'c217d5b8-09d0-4973-bf80-6a8ba8c55f85'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:19 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:19 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:19 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.307s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f0367e6d-283c-436c-b8e9-87c920c1c169 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-4ea1d596-d260-465e-bc42-b4377f98a79d-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-a7104ea6-54b3-4406-a7ec-f5d05167cd86-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-a7104ea6-54b3-4406-a7ec-f5d05167cd86-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-a7104ea6-54b3-4406-a7ec-f5d05167cd86" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-a7104ea6-54b3-4406-a7ec-f5d05167cd86" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7167637f-91c4-4f12-8e0e-67404d1486a3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:20 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 Jul 16 13:03:20 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:20 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86" returned: 0 in 0.465s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:20 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86 Jul 16 13:03:20 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a7104ea6-54b3-4406-a7ec-f5d05167cd86" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:21 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-a7104ea6-54b3-4406-a7ec-f5d05167cd86" released by "delete_volume" :: held 0.877s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['6fe679a1-9228-432c-a589-bd8f3d0f3667', 'f188ee86-ea1a-4080-b66b-9330644f5991', 'cf3950fd-72f5-4c05-9afb-3473258d2f57', '2d71ad8e-7161-4cda-9c28-877dc8811b48'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:21 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:21 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:21 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99bc3c43-c704-4c4a-a5ac-36eab9c4fa5e tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-a7104ea6-54b3-4406-a7ec-f5d05167cd86-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c290114-359e-445a-9f00-97c93577fcd5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:22 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c Jul 16 13:03:22 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:23 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" returned: 0 in 0.530s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:23 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c Jul 16 13:03:23 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:23 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c" released by "delete_volume" :: held 1.028s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['a5b246a2-7235-49cd-b2f1-9a2b45129751', '122efdbf-cd3e-4ac0-b906-d7c738d2086d', '54e7b1d5-1f21-4fa7-91ae-355d5d5b6977', 'b09d5e7f-c4d8-436f-85b7-f6c2fb6de2d0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:23 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:23 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:24 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3ab2ee6a-040d-4ab9-91c8-1bd05183aef9 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-cf8fcc32-e1e3-4d62-b7f9-1538f2d11d8c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleting offline snapshot a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 of volume 6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] snapshot_file for this snap is: volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccde643-189c-4db2-8f8b-38b8edeec978]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:25 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 Jul 16 13:03:25 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:25 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" returned: 0 in 0.662s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6836533d-10c8-4046-9352-d7a3b6eabbf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34c7999-d034-4762-a7b9-5d6b35dd2b03]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:25 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 Jul 16 13:03:25 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:26 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6" returned: 0 in 0.645s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:26 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 Jul 16 13:03:26 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:27 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" returned: 0 in 0.613s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:27 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9 Jul 16 13:03:27 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:27 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6.a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9" released by "_delete_snapshot" :: held 2.596s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" released by "delete_snapshot" :: held 2.651s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['41e390e2-2288-47b3-8063-615e61854566', 'ca26a447-588a-4dae-b787-8958110637e1', '0c49a70e-fc6d-497d-9211-3c6081e87671', '766f89f8-a9bb-47bd-bad6-4b95537c59f1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Delete snapshot completed successfully. Jul 16 13:03:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4689f053-cc19-4bfc-bb86-ca6ba5fa4343 tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-a0ef0be6-b01f-4b2f-a2d2-4ad7b62c2da9-delete_snapshot" released by "delete_snapshot" :: held 2.926s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-6836533d-10c8-4046-9352-d7a3b6eabbf6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-6836533d-10c8-4046-9352-d7a3b6eabbf6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" acquired by "delete_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1f17b-57c2-4f77-bd4f-0995657a340b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:28 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 Jul 16 13:03:28 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:29 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6" returned: 0 in 0.788s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:29 devstack sudo[103895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6 Jul 16 13:03:29 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:29 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6836533d-10c8-4046-9352-d7a3b6eabbf6" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-quobyte-6836533d-10c8-4046-9352-d7a3b6eabbf6" released by "delete_volume" :: held 1.291s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Created reservations ['72877b0d-6091-46f0-abe6-bd6b0ad1de62', '84698edb-6403-48d0-a927-9b8ecde25739', '71d52906-256b-400a-a50f-3e6198243e8a', 'e8a53269-a77e-45a1-949c-22171f8d7170'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:29 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:29 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:30 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Deleted volume successfully. Jul 16 13:03:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-906798ce-5d7d-466e-8bcd-0a13603674de tempest-CreateVolumesFromSnapshotTest-27894975 None] Lock "cinder-6836533d-10c8-4046-9352-d7a3b6eabbf6-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (e759bf5a-8f0b-4c56-94f6-c5f4d3242965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe84a03b-f57b-4833-b951-cbb96f460f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe84a03b-f57b-4833-b951-cbb96f460f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686614153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfe5082-c5b0-47a0-9533-5dc9d410955b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:36Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43a6f7-705c-4641-96d6-fb0ab952a861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df43a6f7-705c-4641-96d6-fb0ab952a861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dcb20d-a715-40b7-88b1-b50c4fcb38bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dcb20d-a715-40b7-88b1-b50c4fcb38bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfe5082-c5b0-47a0-9533-5dc9d410955b', 'volume_name': 'volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbcb382-9aa8-4694-8abf-59d5c6785745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fbcb382-9aa8-4694-8abf-59d5c6785745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9edbf9b-e521-4796-9308-fe040fe6f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume 1cfe5082-c5b0-47a0-9533-5dc9d410955b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b', 'volume_size': 1} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686614153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfe5082-c5b0-47a0-9533-5dc9d410955b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:36Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume 1cfe5082-c5b0-47a0-9533-5dc9d410955b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:36 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b 1073741824 Jul 16 13:03:36 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:36 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b 1073741824" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:37 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b Jul 16 13:03:37 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:37 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9edbf9b-e521-4796-9308-fe040fe6f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827fe0a8-71dc-4345-89c2-5e9d976f0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b (1cfe5082-c5b0-47a0-9533-5dc9d410955b): created successfully Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827fe0a8-71dc-4345-89c2-5e9d976f0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (e759bf5a-8f0b-4c56-94f6-c5f4d3242965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d5455dfb-80cb-4012-b7c2-5f88e8157b39 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (a328c871-99a9-4951-a6d4-a2de0a56c1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6120121-c4b9-4901-ac92-d2faf8723d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6120121-c4b9-4901-ac92-d2faf8723d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722037087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859eeedd-3d43-4521-9802-3f95ec93769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:39Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99648593-4942-4720-b9ee-bfe659c35aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99648593-4942-4720-b9ee-bfe659c35aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab421e-c195-41fb-9afb-728b319569d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fab421e-c195-41fb-9afb-728b319569d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859eeedd-3d43-4521-9802-3f95ec93769f', 'volume_name': 'volume-859eeedd-3d43-4521-9802-3f95ec93769f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291f03b4-34c6-4629-9611-825ff7afca0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (291f03b4-34c6-4629-9611-825ff7afca0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fdffe4-557a-4380-a003-458f42630e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume 859eeedd-3d43-4521-9802-3f95ec93769f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859eeedd-3d43-4521-9802-3f95ec93769f', 'volume_size': 1} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1722037087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=859eeedd-3d43-4521-9802-3f95ec93769f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:39Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume 859eeedd-3d43-4521-9802-3f95ec93769f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:39 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f 1073741824 Jul 16 13:03:39 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (3f76c86f-8504-4d6f-b137-a126061a249a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41af7b50-a573-434e-ab56-f490930c08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41af7b50-a573-434e-ab56-f490930c08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639072864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d40616-9189-49b2-8a71-cd3fdd9f0791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:39Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb07da0-fcca-4f3e-b8e1-3ca718b835b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb07da0-fcca-4f3e-b8e1-3ca718b835b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6550b15-98e9-4d5f-9112-20766b149544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6550b15-98e9-4d5f-9112-20766b149544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d40616-9189-49b2-8a71-cd3fdd9f0791', 'volume_name': 'volume-33d40616-9189-49b2-8a71-cd3fdd9f0791', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fb24e4-604e-47a2-b873-7bdc638794b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fb24e4-604e-47a2-b873-7bdc638794b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ce2c7-abb3-4e3b-a3c4-26d7ba621de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume 33d40616-9189-49b2-8a71-cd3fdd9f0791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d40616-9189-49b2-8a71-cd3fdd9f0791', 'volume_size': 1} Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:39 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f 1073741824" returned: 0 in 0.799s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:40 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f Jul 16 13:03:40 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (29a2c9de-9b61-495f-81b3-9cd3f1ba5f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac47042b-6f5d-4a4b-a7f3-03c7dcbf81d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac47042b-6f5d-4a4b-a7f3-03c7dcbf81d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473561622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfdb891-67b0-40f6-8ab2-1580d4644d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:40Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbad6d7-4b06-443f-adbd-4e2184bc7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbad6d7-4b06-443f-adbd-4e2184bc7c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00148e84-79eb-4556-805a-3f23ca47bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00148e84-79eb-4556-805a-3f23ca47bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfdb891-67b0-40f6-8ab2-1580d4644d30', 'volume_name': 'volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514854a4-4ee2-4b76-9bcf-256c95364efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514854a4-4ee2-4b76-9bcf-256c95364efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862e4a88-0c3c-462f-b1f1-8697a3700d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume ecfdb891-67b0-40f6-8ab2-1580d4644d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30', 'volume_size': 1} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:40 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f" returned: 0 in 0.604s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1639072864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d40616-9189-49b2-8a71-cd3fdd9f0791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:39Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume 33d40616-9189-49b2-8a71-cd3fdd9f0791 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:40 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:40 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 1073741824 Jul 16 13:03:40 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fdffe4-557a-4380-a003-458f42630e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859eeedd-3d43-4521-9802-3f95ec93769f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d092bf-9cc4-4180-a1e6-4d9f2e181763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (dc096e37-4238-46ee-8446-37726c3c047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c56fa98-a9a0-4811-b396-d70cbddf4030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-859eeedd-3d43-4521-9802-3f95ec93769f (859eeedd-3d43-4521-9802-3f95ec93769f): created successfully Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d092bf-9cc4-4180-a1e6-4d9f2e181763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (a328c871-99a9-4951-a6d4-a2de0a56c1ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c56fa98-a9a0-4811-b396-d70cbddf4030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835210000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9c3607-5478-44aa-b5fe-d22d10addaa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:41Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c456fad-226e-402a-a750-a185ed3b7725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c456fad-226e-402a-a750-a185ed3b7725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21790eab-905a-43ef-8302-ec4445aadd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21790eab-905a-43ef-8302-ec4445aadd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9c3607-5478-44aa-b5fe-d22d10addaa3', 'volume_name': 'volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2a99a-d849-4e7a-b9f6-1e4971b49a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2a99a-d849-4e7a-b9f6-1e4971b49a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bb0567-5210-4128-ad07-106cbaa99455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume 4b9c3607-5478-44aa-b5fe-d22d10addaa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3', 'volume_size': 1} Jul 16 13:03:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-db184142-d23b-4501-9cb5-16a099d2f31a tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (a5de9e97-806e-4405-a78d-d7c4d7f79d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45505e4-b2d4-4402-96b5-852e7d860714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a45505e4-b2d4-4402-96b5-852e7d860714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968623117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a21cdff-e6a3-4a57-bc23-6d6829cfaf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:41Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d23b5d3-972b-4089-a013-409a43be3409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d23b5d3-972b-4089-a013-409a43be3409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2b5346-30de-48b1-a83d-f5f52c8d5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2b5346-30de-48b1-a83d-f5f52c8d5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a21cdff-e6a3-4a57-bc23-6d6829cfaf65', 'volume_name': 'volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37e73c1-aa9f-4162-92b0-3ed9a82362f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e37e73c1-aa9f-4162-92b0-3ed9a82362f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665d0e64-7dae-439b-870e-b3f90a7133f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume 3a21cdff-e6a3-4a57-bc23-6d6829cfaf65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65', 'volume_size': 1} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 1073741824" returned: 0 in 0.861s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:41 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 Jul 16 13:03:41 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:41 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473561622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecfdb891-67b0-40f6-8ab2-1580d4644d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:40Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume ecfdb891-67b0-40f6-8ab2-1580d4644d30 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771ce2c7-abb3-4e3b-a3c4-26d7ba621de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d40616-9189-49b2-8a71-cd3fdd9f0791', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e854ae12-ee44-4e3b-b569-aab42b872ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:41 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 1073741824 Jul 16 13:03:41 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 (33d40616-9189-49b2-8a71-cd3fdd9f0791): created successfully Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e854ae12-ee44-4e3b-b569-aab42b872ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (3f76c86f-8504-4d6f-b137-a126061a249a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c57f96d7-38b6-4c5b-ab3c-d979a0ff856c tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:42 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 1073741824" returned: 0 in 0.579s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:42 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 Jul 16 13:03:42 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:42 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-835210000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9c3607-5478-44aa-b5fe-d22d10addaa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:41Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume 4b9c3607-5478-44aa-b5fe-d22d10addaa3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862e4a88-0c3c-462f-b1f1-8697a3700d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:42 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 1073741824 Jul 16 13:03:42 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc9e1b6-1e9f-400d-8983-e6a21e7c5a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 (ecfdb891-67b0-40f6-8ab2-1580d4644d30): created successfully Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afc9e1b6-1e9f-400d-8983-e6a21e7c5a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (29a2c9de-9b61-495f-81b3-9cd3f1ba5f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d40dd89e-cbb6-4369-9c59-ddadb7c0f394 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:43 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 1073741824" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:43 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 Jul 16 13:03:43 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:43 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.093s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968623117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a21cdff-e6a3-4a57-bc23-6d6829cfaf65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d160c1928e4ad3ae033bda00b116bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:03:41Z,use_quota=True,user_id='15617f652a90408eb14c2a3695e8a0d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Creating volume 3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:03:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bb0567-5210-4128-ad07-106cbaa99455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:43 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 1073741824 Jul 16 13:03:43 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58dbea7-778f-4938-bdd0-bfd3ab7aa815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 (4b9c3607-5478-44aa-b5fe-d22d10addaa3): created successfully Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58dbea7-778f-4938-bdd0-bfd3ab7aa815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (dc096e37-4238-46ee-8446-37726c3c047f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5eca7fee-b5a7-4798-bac9-ae874cf1f6de tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:44 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 1073741824" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:44 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 Jul 16 13:03:44 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:44 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665d0e64-7dae-439b-870e-b3f90a7133f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505c3374-eafc-42ba-82b8-7f737159dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:03:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Volume volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 (3a21cdff-e6a3-4a57-bc23-6d6829cfaf65): created successfully Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505c3374-eafc-42ba-82b8-7f737159dfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Flow 'volume_create_manager' (a5de9e97-806e-4405-a78d-d7c4d7f79d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:03:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-12097644-89fc-4661-818a-afb0631c66d0 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created volume successfully. Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9eb2bf-9a53-484c-993b-9951c41c410b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:45 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 Jul 16 13:03:45 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:45 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:45 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65 Jul 16 13:03:45 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:45 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65" released by "delete_volume" :: held 0.817s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['036df6e7-a571-44ee-bae1-167b80afb04c', 'eca1b745-fff0-4fd7-814f-7a2e66f97084', 'b1932080-feff-43fe-9db6-23022b4baec7', 'c082a26e-bb12-4a4a-b3c9-51d43d4fa304'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:45 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:45 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-4b9c3607-5478-44aa-b5fe-d22d10addaa3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-4b9c3607-5478-44aa-b5fe-d22d10addaa3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-4b9c3607-5478-44aa-b5fe-d22d10addaa3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-4b9c3607-5478-44aa-b5fe-d22d10addaa3" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0378a-d01b-45d7-b0d3-3adc778ce60b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:46 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17b364c6-feae-4619-bbb2-5df2b6556301 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-3a21cdff-e6a3-4a57-bc23-6d6829cfaf65-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:46 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 Jul 16 13:03:46 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:46 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:46 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3 Jul 16 13:03:46 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:46 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4b9c3607-5478-44aa-b5fe-d22d10addaa3" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-4b9c3607-5478-44aa-b5fe-d22d10addaa3" released by "delete_volume" :: held 0.763s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['9d9d6a90-1349-4e80-81df-b1bb0866313d', 'd12221ae-7c04-47ec-ad01-d32ee15b24d7', 'ea2351d3-f4c9-4faf-9dc3-14bec6f3d2eb', 'ceea68ce-603a-4a01-8af4-69a26a9ff3dc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:47 devstack sudo[104054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:47 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-ecfdb891-67b0-40f6-8ab2-1580d4644d30-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-ecfdb891-67b0-40f6-8ab2-1580d4644d30-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-ecfdb891-67b0-40f6-8ab2-1580d4644d30" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-ecfdb891-67b0-40f6-8ab2-1580d4644d30" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a60432-2b3b-4126-91fe-10cc417618e8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:47 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-693cee0c-3a20-4aa3-806e-de61be9149f7 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-4b9c3607-5478-44aa-b5fe-d22d10addaa3-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:47 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 Jul 16 13:03:47 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:47 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:47 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30 Jul 16 13:03:47 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:48 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ecfdb891-67b0-40f6-8ab2-1580d4644d30" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-ecfdb891-67b0-40f6-8ab2-1580d4644d30" released by "delete_volume" :: held 0.752s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['ffcb6600-9cef-417f-9bdb-55790cd0791a', 'a619ff64-7efc-4b57-8a9b-6e8f75e583ab', '8d3aba36-226a-4dec-a0dc-625868f3dce4', '838cbc65-433d-45b4-9562-1879bf6f6139'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:48 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:48 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-33d40616-9189-49b2-8a71-cd3fdd9f0791-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-33d40616-9189-49b2-8a71-cd3fdd9f0791-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-33d40616-9189-49b2-8a71-cd3fdd9f0791" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:48 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-33d40616-9189-49b2-8a71-cd3fdd9f0791" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[72321340-e99e-4035-8973-e94895ef395d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d41b57a-6cfb-48e1-acac-f7a14d7bce1e tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-ecfdb891-67b0-40f6-8ab2-1580d4644d30-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:48 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 Jul 16 13:03:48 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:49 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:49 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791 Jul 16 13:03:49 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:49 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-33d40616-9189-49b2-8a71-cd3fdd9f0791" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-33d40616-9189-49b2-8a71-cd3fdd9f0791" released by "delete_volume" :: held 0.782s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['827ed72b-2361-428f-8be3-128988a8ad9f', '5b54450a-4a4c-4d3f-ac32-c84db195cf66', '2be8b8e9-5037-47fd-b0d9-834687a14a6a', '82302e5a-00b7-4e44-8bdd-8295856992db'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:49 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:49 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-859eeedd-3d43-4521-9802-3f95ec93769f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-859eeedd-3d43-4521-9802-3f95ec93769f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-859eeedd-3d43-4521-9802-3f95ec93769f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-859eeedd-3d43-4521-9802-3f95ec93769f" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4c0ad-aac5-4d71-90e3-543d1b942e38]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:49 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-67ea8377-35dd-42d7-889c-56f9269b970d tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-33d40616-9189-49b2-8a71-cd3fdd9f0791-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:49 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f Jul 16 13:03:49 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:50 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f" returned: 0 in 0.381s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:50 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f Jul 16 13:03:50 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:50 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-859eeedd-3d43-4521-9802-3f95ec93769f" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-859eeedd-3d43-4521-9802-3f95ec93769f" released by "delete_volume" :: held 0.724s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['4ecc4bc1-59fd-4d97-b143-9592cab7567b', 'e06c3a22-c522-4f2c-af53-eef4225eca6c', '9828fafe-20d6-465f-8e32-ddd41c4402c5', 'cfd4558e-0b0c-4727-8272-076521318fc2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:50 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:50 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-1cfe5082-c5b0-47a0-9533-5dc9d410955b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-1cfe5082-c5b0-47a0-9533-5dc9d410955b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "cinder-quobyte-1cfe5082-c5b0-47a0-9533-5dc9d410955b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-1cfe5082-c5b0-47a0-9533-5dc9d410955b" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf4636-c874-4750-91db-cd94bbf0ce5a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:51 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.515s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f9dd38f-36c4-485b-a01b-04a71657e5fe tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-859eeedd-3d43-4521-9802-3f95ec93769f-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:51 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b Jul 16 13:03:51 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:51 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b" returned: 0 in 0.513s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:51 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b Jul 16 13:03:51 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-893e0fbd-b4fb-476d-9f03-f4963a88d1c9 req-d3ffc240-45fc-411e-8863-d084d15cea99 tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-893e0fbd-b4fb-476d-9f03-f4963a88d1c9 req-d3ffc240-45fc-411e-8863-d084d15cea99 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-893e0fbd-b4fb-476d-9f03-f4963a88d1c9 req-d3ffc240-45fc-411e-8863-d084d15cea99 tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-893e0fbd-b4fb-476d-9f03-f4963a88d1c9 req-d3ffc240-45fc-411e-8863-d084d15cea99 tempest-TestInstancesWithCinderVolumes-1868483909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '101f21f1-32ca-4ffb-9d6f-621b133b659f', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:03:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-893e0fbd-b4fb-476d-9f03-f4963a88d1c9 req-d3ffc240-45fc-411e-8863-d084d15cea99 tempest-TestInstancesWithCinderVolumes-1868483909 None] attachment_update completed successfully. Jul 16 13:03:52 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1cfe5082-c5b0-47a0-9533-5dc9d410955b" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-quobyte-1cfe5082-c5b0-47a0-9533-5dc9d410955b" released by "delete_volume" :: held 1.057s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Created reservations ['6cc67e8f-15e3-4b8b-9937-ae448bd0f731', 'aa9d68d9-005e-49a6-b000-0e9a27277217', '6503c7bb-56a6-4da1-afe6-d4b37b444279', '3abf7093-ade7-4c80-9583-81c6e2d6c438'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:03:52 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:03:52 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:03:52 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:03:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Deleted volume successfully. Jul 16 13:03:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2149181f-5af5-4188-971d-e85295085e57 tempest-CreateVolumesFromSourceVolumeTest-386677472 None] Lock "cinder-1cfe5082-c5b0-47a0-9533-5dc9d410955b-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:03:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-90ad19b2-7f1a-40de-b503-7639300ae368 req-d895a1fe-1673-4e5f-9b3c-02d92e2a733d tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:03:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-90ad19b2-7f1a-40de-b503-7639300ae368 req-d895a1fe-1673-4e5f-9b3c-02d92e2a733d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:03:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-90ad19b2-7f1a-40de-b503-7639300ae368 req-d895a1fe-1673-4e5f-9b3c-02d92e2a733d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:03:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-90ad19b2-7f1a-40de-b503-7639300ae368 req-d895a1fe-1673-4e5f-9b3c-02d92e2a733d tempest-TestInstancesWithCinderVolumes-1868483909 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '803de63a-bb2a-4361-844c-cc19bd14ff9a', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:03:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-90ad19b2-7f1a-40de-b503-7639300ae368 req-d895a1fe-1673-4e5f-9b3c-02d92e2a733d tempest-TestInstancesWithCinderVolumes-1868483909 None] attachment_update completed successfully. Jul 16 13:04:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=139,cinder:UPDATE=162,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:04:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=123,cinder:UPDATE=162,cinder:INSERT=42,cinder:DELETE=16 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:04:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-28ec193e-4ac2-42a6-9c1c-d4ea98dd36ab req-821a8728-a151-4d86-ab43-66310991512d tempest-TestInstancesWithCinderVolumes-1868483909 None] Terminate volume connection completed successfully. Jul 16 13:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-28ec193e-4ac2-42a6-9c1c-d4ea98dd36ab req-821a8728-a151-4d86-ab43-66310991512d tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleting attachment 101f21f1-32ca-4ffb-9d6f-621b133b659f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-6d9dc75c-5397-4ea2-893b-d008e96ba0ae-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-6d9dc75c-5397-4ea2-893b-d008e96ba0ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-quobyte-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a674cc-d6c9-457d-9692-6b1a1abe0e59]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:03 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae Jul 16 13:04:03 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:03 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:03 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae Jul 16 13:04:03 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:04 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-6d9dc75c-5397-4ea2-893b-d008e96ba0ae" released by "delete_volume" :: held 0.742s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:04 devstack cinder-volume[87560]: WARNING cinder.quota [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1324241083-670759140 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1324241083-670759140, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:04 devstack cinder-volume[87560]: WARNING cinder.quota [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1324241083-670759140 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1324241083-670759140, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Created reservations ['b25310be-a137-4d06-84d7-1b4de8bdfd1d', '42f58ab3-fef8-4a63-9b96-08f15d51d141', 'f973563a-a113-4abe-890b-ba0a64601ac8', '7065986e-d7ce-4662-b972-8a4910067cc3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:04 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:04 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:04 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleted volume successfully. Jul 16 13:04:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84b2011e-567a-4682-b5f7-bc7087dde84f tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-6d9dc75c-5397-4ea2-893b-d008e96ba0ae-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-632a2918-4a6b-4b47-b8f5-61adb7971a63 req-ac1ddd1e-f15f-417d-b73d-8c1ae99a6d69 tempest-TestInstancesWithCinderVolumes-1868483909 None] Terminate volume connection completed successfully. Jul 16 13:04:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-632a2918-4a6b-4b47-b8f5-61adb7971a63 req-ac1ddd1e-f15f-417d-b73d-8c1ae99a6d69 tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleting attachment 803de63a-bb2a-4361-844c-cc19bd14ff9a. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-b1fea8dc-94a8-4567-ab77-b89b0b7779d6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-b1fea8dc-94a8-4567-ab77-b89b0b7779d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-quobyte-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd5a385-ff72-4bc0-9ac5-0fcc7c3c58b0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:07 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 Jul 16 13:04:07 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:08 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:08 devstack sudo[104339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6 Jul 16 13:04:08 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:08 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-b1fea8dc-94a8-4567-ab77-b89b0b7779d6" released by "delete_volume" :: held 0.783s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:08 devstack cinder-volume[87560]: WARNING cinder.quota [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960138185-519263239 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960138185-519263239, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:08 devstack cinder-volume[87560]: WARNING cinder.quota [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960138185-519263239 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1960138185-519263239, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Created reservations ['b1c3361f-f3be-4811-979a-6822498c92f1', 'e0eed8c3-e119-48cd-94ba-a74f25bb183a', 'ef3c978a-3f95-4905-9083-3af13c09b7a5', '5516f041-ee49-4ebc-9604-1a10f3d0bf37'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:08 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:08 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:08 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:08 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:09 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:09 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:04:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleted volume successfully. Jul 16 13:04:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-639ee70f-5732-49b0-84fa-f7e2a08c47be tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-b1fea8dc-94a8-4567-ab77-b89b0b7779d6-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-90d99f03-de79-4413-b5ef-8eb2a7de4a41 req-0fbc5de0-1e40-4807-a7f5-0b05afe647c8 tempest-TestInstancesWithCinderVolumes-1868483909 None] Terminate volume connection completed successfully. Jul 16 13:04:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-90d99f03-de79-4413-b5ef-8eb2a7de4a41 req-0fbc5de0-1e40-4807-a7f5-0b05afe647c8 tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleting attachment 0bf8122c-4f22-4175-b924-c7cfde817597. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-12be652a-cbd0-413b-832d-c36ece29ca37-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-12be652a-cbd0-413b-832d-c36ece29ca37-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "cinder-quobyte-12be652a-cbd0-413b-832d-c36ece29ca37" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-12be652a-cbd0-413b-832d-c36ece29ca37" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2446d972-1fec-430a-8d71-e6eb06dc94df]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:13 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 Jul 16 13:04:13 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:13 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:13 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37 Jul 16 13:04:13 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:13 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12be652a-cbd0-413b-832d-c36ece29ca37" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-quobyte-12be652a-cbd0-413b-832d-c36ece29ca37" released by "delete_volume" :: held 0.632s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:13 devstack cinder-volume[87560]: WARNING cinder.quota [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1708612550-1116629091 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1708612550-1116629091, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:13 devstack cinder-volume[87560]: WARNING cinder.quota [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1708612550-1116629091 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1708612550-1116629091, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Created reservations ['767a54eb-3431-4266-bfed-d951fdae382c', 'f00f5b83-be56-4cb4-8b1d-c4865300c573', '4b23796b-01f2-4041-a515-9d871e52b096', '58ff3dfe-2584-4b17-9e7d-8a97d1d56c3c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:13 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:13 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:13 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Deleted volume successfully. Jul 16 13:04:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2fa7ca8-b48b-4cd1-9f4b-e667757c6f7d tempest-TestInstancesWithCinderVolumes-1868483909 None] Lock "cinder-12be652a-cbd0-413b-832d-c36ece29ca37-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Flow 'volume_create_manager' (1814752c-00f9-4064-be5b-4ebf573683a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de327c5e-7a1b-4c79-9a22-002933a5ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de327c5e-7a1b-4c79-9a22-002933a5ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-79214724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4663fb10-426c-4d1d-ad52-1df773fd111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ecf45a5cdf4c4fb16e8785007c2b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:20Z,use_quota=True,user_id='235aa83d330a4010a965147b089d9234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36292e2b-9dda-4c51-a93d-c8376fedd0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36292e2b-9dda-4c51-a93d-c8376fedd0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9da295-a1f0-481a-a22a-e15245488e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9da295-a1f0-481a-a22a-e15245488e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4663fb10-426c-4d1d-ad52-1df773fd111b', 'volume_name': 'volume-4663fb10-426c-4d1d-ad52-1df773fd111b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf40aac-5e41-4302-afdd-662e4ed1fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf40aac-5e41-4302-afdd-662e4ed1fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d826b1cd-ef3c-4c65-aa5a-ffbd6c1cb969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Volume 4663fb10-426c-4d1d-ad52-1df773fd111b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4663fb10-426c-4d1d-ad52-1df773fd111b', 'volume_size': 1} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-79214724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4663fb10-426c-4d1d-ad52-1df773fd111b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ecf45a5cdf4c4fb16e8785007c2b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:20Z,use_quota=True,user_id='235aa83d330a4010a965147b089d9234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Creating volume 4663fb10-426c-4d1d-ad52-1df773fd111b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:20 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:20 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b 1073741824 Jul 16 13:04:20 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:20 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b 1073741824" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:20 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b Jul 16 13:04:20 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:21 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d826b1cd-ef3c-4c65-aa5a-ffbd6c1cb969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4663fb10-426c-4d1d-ad52-1df773fd111b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa6e7ee-caa0-479e-b5a8-f6902c57e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Volume volume-4663fb10-426c-4d1d-ad52-1df773fd111b (4663fb10-426c-4d1d-ad52-1df773fd111b): created successfully Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa6e7ee-caa0-479e-b5a8-f6902c57e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Flow 'volume_create_manager' (1814752c-00f9-4064-be5b-4ebf573683a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8f9c0c16-182b-4b4c-8f27-880efba73ad6 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Created volume successfully. Jul 16 13:04:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb983d4b-3da8-4568-b3be-f61d5dbd3aee req-419141fc-2cca-4a7b-994a-c28fcac5609d tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb983d4b-3da8-4568-b3be-f61d5dbd3aee req-419141fc-2cca-4a7b-994a-c28fcac5609d tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bb983d4b-3da8-4568-b3be-f61d5dbd3aee req-419141fc-2cca-4a7b-994a-c28fcac5609d tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bb983d4b-3da8-4568-b3be-f61d5dbd3aee req-419141fc-2cca-4a7b-994a-c28fcac5609d tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1', 'name': 'volume-4663fb10-426c-4d1d-ad52-1df773fd111b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72eae88a-3ffc-4f1e-a5b8-c68a30d93b49', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 16 13:04:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bb983d4b-3da8-4568-b3be-f61d5dbd3aee req-419141fc-2cca-4a7b-994a-c28fcac5609d tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] attachment_update completed successfully. Jul 16 13:04:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-1d5bb5e6-b497-4e7c-b7f0-4a5df0492068 req-ff6e8631-d24e-49a5-8219-e50606b3dfad tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Terminate volume connection completed successfully. Jul 16 13:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-1d5bb5e6-b497-4e7c-b7f0-4a5df0492068 req-ff6e8631-d24e-49a5-8219-e50606b3dfad tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Deleting attachment 72eae88a-3ffc-4f1e-a5b8-c68a30d93b49. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "cinder-4663fb10-426c-4d1d-ad52-1df773fd111b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "cinder-4663fb10-426c-4d1d-ad52-1df773fd111b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "cinder-quobyte-4663fb10-426c-4d1d-ad52-1df773fd111b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "cinder-quobyte-4663fb10-426c-4d1d-ad52-1df773fd111b" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94547bd-ce0f-4e5c-9b78-f1b7303befe0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:27 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b Jul 16 13:04:27 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:27 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:27 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b Jul 16 13:04:27 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:28 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4663fb10-426c-4d1d-ad52-1df773fd111b" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "cinder-quobyte-4663fb10-426c-4d1d-ad52-1df773fd111b" released by "delete_volume" :: held 0.692s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Created reservations ['513d735b-d01b-455a-9c99-3220d0725657', 'fc96b913-8900-466a-960f-5aa4af1a91be', '3714a29c-73ca-4366-ad7d-ab9ee88f0ff5', '09345871-5bce-491b-bd39-1a7b92fc2e0d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:28 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:28 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:28 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Deleted volume successfully. Jul 16 13:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42998d44-5fde-481f-b37d-c5c2e60e1a37 tempest-TestServerVolumeAttachScenarioOldVersion-1816501035 None] Lock "cinder-4663fb10-426c-4d1d-ad52-1df773fd111b-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (bedfb387-462a-4af0-956c-657b8786f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7cffd8-1dc8-45af-926b-f8315e4dd32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7cffd8-1dc8-45af-926b-f8315e4dd32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132596473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be24c6a9-f7af-48dd-b985-4a3c47dacd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:32Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4818701e-5875-4836-9594-47d8a35042e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4818701e-5875-4836-9594-47d8a35042e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8283cabe-c3a8-4a2e-8773-9bda69b17bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8283cabe-c3a8-4a2e-8773-9bda69b17bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be24c6a9-f7af-48dd-b985-4a3c47dacd97', 'volume_name': 'volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6521f2-a80e-4c48-be32-fe322e4260a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d6521f2-a80e-4c48-be32-fe322e4260a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d804f8fe-5d6f-42ec-a62e-87e545fe052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Volume be24c6a9-f7af-48dd-b985-4a3c47dacd97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97', 'volume_size': 1} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-132596473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be24c6a9-f7af-48dd-b985-4a3c47dacd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:32Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Creating volume be24c6a9-f7af-48dd-b985-4a3c47dacd97 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:32 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:32 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 1073741824 Jul 16 13:04:32 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:32 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 1073741824" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:32 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 Jul 16 13:04:32 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:32 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d804f8fe-5d6f-42ec-a62e-87e545fe052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c768aa-822b-406d-ac24-f3d7b9b0a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Volume volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 (be24c6a9-f7af-48dd-b985-4a3c47dacd97): created successfully Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c768aa-822b-406d-ac24-f3d7b9b0a07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (bedfb387-462a-4af0-956c-657b8786f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3cba569b-b826-48fd-a19f-71763e374641 tempest-ProjectReaderTests-1434151840 None] Created volume successfully. Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-be24c6a9-f7af-48dd-b985-4a3c47dacd97-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-be24c6a9-f7af-48dd-b985-4a3c47dacd97-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-quobyte-be24c6a9-f7af-48dd-b985-4a3c47dacd97" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-be24c6a9-f7af-48dd-b985-4a3c47dacd97" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46926521-cfe0-4b7d-b3bd-3e71949987cb]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:33 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 Jul 16 13:04:33 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:33 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:33 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97 Jul 16 13:04:33 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:33 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-be24c6a9-f7af-48dd-b985-4a3c47dacd97" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-be24c6a9-f7af-48dd-b985-4a3c47dacd97" released by "delete_volume" :: held 0.695s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Created reservations ['62ab9f20-bb41-4e79-a7ba-2667cbb1e397', 'c33731f8-2f4b-467a-88ff-24aa5cafde7d', '0e2fca47-5380-49ee-b4bf-5b6215e870b1', 'c725f682-2c49-4013-8c0b-48c92632e1d7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:34 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:34 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:34 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Deleted volume successfully. Jul 16 13:04:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b976db18-cc12-4386-b67d-7c916e33f321 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-be24c6a9-f7af-48dd-b985-4a3c47dacd97-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (03cf4e3d-4095-48a8-9ea1-c28cc81a2451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f3799d-596d-412d-9482-fa8295b8fd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f3799d-596d-412d-9482-fa8295b8fd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889300405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d2ef9c-1567-49f8-ad1f-1da0400675b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:35Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad3b92-1fa5-4bab-846f-1a59db7d3721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad3b92-1fa5-4bab-846f-1a59db7d3721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35a691b-5430-4169-a156-633e2e37e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35a691b-5430-4169-a156-633e2e37e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d2ef9c-1567-49f8-ad1f-1da0400675b3', 'volume_name': 'volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bce8d1-aee9-4eab-9bed-7d07d5d9fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bce8d1-aee9-4eab-9bed-7d07d5d9fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f5536d-9650-4a15-abfe-6c0808e29520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Volume e9d2ef9c-1567-49f8-ad1f-1da0400675b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3', 'volume_size': 1} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1889300405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d2ef9c-1567-49f8-ad1f-1da0400675b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:35Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Creating volume e9d2ef9c-1567-49f8-ad1f-1da0400675b3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:35 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:35 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 1073741824 Jul 16 13:04:35 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:35 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 1073741824" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:35 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 Jul 16 13:04:35 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:35 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f5536d-9650-4a15-abfe-6c0808e29520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212336b-6a1c-4590-b3d6-f1f2cada3372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Volume volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 (e9d2ef9c-1567-49f8-ad1f-1da0400675b3): created successfully Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212336b-6a1c-4590-b3d6-f1f2cada3372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (03cf4e3d-4095-48a8-9ea1-c28cc81a2451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a71277a9-bfbf-412f-9320-04a56253280c tempest-ProjectReaderTests-1434151840 None] Created volume successfully. Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-e9d2ef9c-1567-49f8-ad1f-1da0400675b3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-e9d2ef9c-1567-49f8-ad1f-1da0400675b3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-quobyte-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[403beec9-4f2e-46ab-93bb-4e7303325d3b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:37 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 Jul 16 13:04:37 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:37 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:37 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3 Jul 16 13:04:37 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:37 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-e9d2ef9c-1567-49f8-ad1f-1da0400675b3" released by "delete_volume" :: held 0.659s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Created reservations ['9a263eea-cc33-4b28-ae08-25088548dde6', 'd2f40f37-f176-48f8-bd73-3f8540c9ec9e', 'eb568ae1-7e86-4515-9c2a-140c193b6d77', 'b0f08f99-77e2-4543-830f-2c56a101160c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:38 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:38 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:38 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Deleted volume successfully. Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4353c40f-0226-4f91-9dca-8c940ce1db78 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-e9d2ef9c-1567-49f8-ad1f-1da0400675b3-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (27955c05-24af-4766-b18f-b026b0fde11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71af0492-8af4-45fc-8295-8b9cc3b286fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71af0492-8af4-45fc-8295-8b9cc3b286fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725627801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd77ecd5-feb2-4d43-9325-3096ac7b5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:39Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858a8618-1c94-4518-908a-e9e746669ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858a8618-1c94-4518-908a-e9e746669ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab115ae9-7c9f-401c-9e19-2863f66d33a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab115ae9-7c9f-401c-9e19-2863f66d33a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd77ecd5-feb2-4d43-9325-3096ac7b5030', 'volume_name': 'volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97481ee-5352-4f94-9def-c44641960e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97481ee-5352-4f94-9def-c44641960e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a656ac55-4e0c-4f8a-b3b8-87f05393c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Volume fd77ecd5-feb2-4d43-9325-3096ac7b5030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030', 'volume_size': 1} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-725627801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd77ecd5-feb2-4d43-9325-3096ac7b5030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:39Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Creating volume fd77ecd5-feb2-4d43-9325-3096ac7b5030 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:38 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 1073741824 Jul 16 13:04:38 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:39 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 1073741824" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:39 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 Jul 16 13:04:39 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:39 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a656ac55-4e0c-4f8a-b3b8-87f05393c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4290c133-b267-4961-a0ad-c8874c4fd0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Volume volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 (fd77ecd5-feb2-4d43-9325-3096ac7b5030): created successfully Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4290c133-b267-4961-a0ad-c8874c4fd0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (27955c05-24af-4766-b18f-b026b0fde11a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0abe673c-36fd-489a-bbef-836f27b64c70 tempest-ProjectReaderTests-1434151840 None] Created volume successfully. Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-fd77ecd5-feb2-4d43-9325-3096ac7b5030-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-fd77ecd5-feb2-4d43-9325-3096ac7b5030-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-quobyte-fd77ecd5-feb2-4d43-9325-3096ac7b5030" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-fd77ecd5-feb2-4d43-9325-3096ac7b5030" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[31287f0f-e4c1-46e6-ba62-e7f6548b41db]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:40 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 Jul 16 13:04:40 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:40 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:40 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030 Jul 16 13:04:40 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:40 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-fd77ecd5-feb2-4d43-9325-3096ac7b5030" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-fd77ecd5-feb2-4d43-9325-3096ac7b5030" released by "delete_volume" :: held 0.687s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Created reservations ['0e94cbef-d402-46b1-8640-c2f10aa0d383', '84bd0f20-5f6b-4ef2-9b1e-8c233bca1022', 'a459d222-9399-4082-9f8e-7020fc9c6a15', 'be943beb-25b4-4d96-8210-c2c2f56c318b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:40 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:40 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:41 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Deleted volume successfully. Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-394f26be-c2bc-4869-8185-68324d558d42 tempest-ProjectReaderTests-1434151840 None] Lock "cinder-fd77ecd5-feb2-4d43-9325-3096ac7b5030-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (ea0b582f-a25e-4dc4-8c8a-1b77b6e5caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fbd80a-692d-4529-a986-ad73c3b13e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fbd80a-692d-4529-a986-ad73c3b13e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1307318611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0bbd4f-8169-4aab-888b-6efbdc6b3880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:42Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f55fa7-382b-421d-bb2a-3a0b4d8aa56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f55fa7-382b-421d-bb2a-3a0b4d8aa56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7025cf38-4552-419c-802c-f7343f70259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7025cf38-4552-419c-802c-f7343f70259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0bbd4f-8169-4aab-888b-6efbdc6b3880', 'volume_name': 'volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ccefb1-ac12-4f74-95a7-25d865f74697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ccefb1-ac12-4f74-95a7-25d865f74697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7a274-2333-4341-90e8-f224b576bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Volume cc0bbd4f-8169-4aab-888b-6efbdc6b3880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880', 'volume_size': 1} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1307318611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0bbd4f-8169-4aab-888b-6efbdc6b3880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da840bec8996405e87ae6f5ef1895b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:42Z,use_quota=True,user_id='689ca7e2b9354536875f1839d8eed985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Creating volume cc0bbd4f-8169-4aab-888b-6efbdc6b3880 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:41 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 1073741824 Jul 16 13:04:41 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:42 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 1073741824" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:42 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 Jul 16 13:04:42 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:42 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7a274-2333-4341-90e8-f224b576bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1b59ce-54ee-4a42-ae32-d23ed539c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Volume volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 (cc0bbd4f-8169-4aab-888b-6efbdc6b3880): created successfully Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1b59ce-54ee-4a42-ae32-d23ed539c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Flow 'volume_create_manager' (ea0b582f-a25e-4dc4-8c8a-1b77b6e5caf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5d7d27df-dbc4-421f-94d3-4d73a0c52837 tempest-ProjectReaderTests-1434151840 None] Created volume successfully. Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-cc0bbd4f-8169-4aab-888b-6efbdc6b3880-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "cinder-cc0bbd4f-8169-4aab-888b-6efbdc6b3880-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Acquiring lock "cinder-quobyte-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caeab60-e874-419d-a476-a53ac3402153]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:43 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 Jul 16 13:04:43 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:44 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" returned: 0 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:44 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880 Jul 16 13:04:44 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:44 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "cinder-quobyte-cc0bbd4f-8169-4aab-888b-6efbdc6b3880" released by "delete_volume" :: held 0.698s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Created reservations ['4cb21e1e-1544-4331-9c5c-62f4bb6740ac', '6ac2c4cf-df96-4229-8d5c-e3409ae40aa7', '7f3ab6e5-8d81-4f10-ba6c-3bc1c4157085', '43ebed0b-64d7-4337-9c1e-21098d9d2564'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:44 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:44 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:44 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Deleted volume successfully. Jul 16 13:04:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4a430dff-1219-4565-b4e2-56711489b37c tempest-ProjectReaderTests-1434151840 None] Lock "cinder-cc0bbd4f-8169-4aab-888b-6efbdc6b3880-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Flow 'volume_create_manager' (a43d04dc-e781-4f4c-bf4e-47d248ee769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99be000-473a-4b3e-9545-ba5d79a64648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99be000-473a-4b3e-9545-ba5d79a64648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea2c5ab2d104730b93c0bcb623882d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:46Z,use_quota=True,user_id='f8a07607539849c2bf5c97ef358b2536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565a086f-4116-4598-a3c9-e5ee874a0504),volume_type_id=565a086f-4116-4598-a3c9-e5ee874a0504)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844b775-c9e8-4f65-8ce2-eb04da0cde68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8844b775-c9e8-4f65-8ce2-eb04da0cde68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18dcbd-0987-459b-b1ca-beef2ef60055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e18dcbd-0987-459b-b1ca-beef2ef60055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013', 'volume_name': 'volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013', 'volume_size': 1, 'image_id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62cc3504f572430e138937785a1af3df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ea2c5ab2d104730b93c0bcb623882d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '742f294364b036a6bf55d9b80f53ef5d1f72feebff7cf09ebec62fe7b5410de4d211c202af3e1f77234122711a4fefbe897edc36ee08ec73f98fc5e33a171522', 'id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7eb792f-211b-4ae6-864b-ff158c4bee13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062da3c3-bff5-4b9c-94a8-93433bf41ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062da3c3-bff5-4b9c-94a8-93433bf41ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088aed61-1e9f-41c1-b7ae-6090e72be38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013', 'volume_size': 1, 'image_id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62cc3504f572430e138937785a1af3df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ea2c5ab2d104730b93c0bcb623882d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '742f294364b036a6bf55d9b80f53ef5d1f72feebff7cf09ebec62fe7b5410de4d211c202af3e1f77234122711a4fefbe897edc36ee08ec73f98fc5e33a171522', 'id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7eb792f-211b-4ae6-864b-ff158c4bee13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Trying to clone 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 from image c7eb792f-211b-4ae6-864b-ff158c4bee13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:04:46 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Image download 0.00 MB at 0.00 MB/s Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fb5e22-caaa-43ea-b5e9-f326fe35d1ae]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:46 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:46 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:46 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:47 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:47 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:47 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Temporary image c7eb792f-211b-4ae6-864b-ff158c4bee13 is fetched for user f8a07607539849c2bf5c97ef358b2536. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1c200-63dc-4d6c-89a5-89b71068c68f]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:47 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:47 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:47 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:47 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:47 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:47 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea2c5ab2d104730b93c0bcb623882d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:46Z,use_quota=True,user_id='f8a07607539849c2bf5c97ef358b2536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565a086f-4116-4598-a3c9-e5ee874a0504),volume_type_id=565a086f-4116-4598-a3c9-e5ee874a0504)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Creating volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:04:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:47 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1073741824 Jul 16 13:04:47 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:48 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1073741824" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:48 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 Jul 16 13:04:48 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:48 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Attempting download of c7eb792f-211b-4ae6-864b-ff158c4bee13 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}])) to volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[55392172-3cb3-4e18-8679-b39f45774647]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:48 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey Jul 16 13:04:48 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:49 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:49 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey Jul 16 13:04:49 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:49 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey" returned: 1 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c7eb792f-211b-4ae6-864b-ff158c4bee13_am2inpey' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cdc368-1ce2-4e22-83c1-91705e1ee16e]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:49 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:49 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:49 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:49 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD Jul 16 13:04:49 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:49 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] c7eb792f-211b-4ae6-864b-ff158c4bee13 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:50 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 Jul 16 13:04:50 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:50 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c7eb792f-211b-4ae6-864b-ff158c4bee13_dmz45cj9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:04:50 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:50 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1G Jul 16 13:04:50 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:50 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 1G" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Downloaded image c7eb792f-211b-4ae6-864b-ff158c4bee13 ((None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}])) to volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Temporary image c7eb792f-211b-4ae6-864b-ff158c4bee13 for user f8a07607539849c2bf5c97ef358b2536 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Marking volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Copying metadata from image c7eb792f-211b-4ae6-864b-ff158c4bee13 to 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Creating volume glance metadata for volume 38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 backed by image c7eb792f-211b-4ae6-864b-ff158c4bee13 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '62cc3504f572430e138937785a1af3df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088aed61-1e9f-41c1-b7ae-6090e72be38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013', 'volume_size': 1, 'image_id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c7eb792f-211b-4ae6-864b-ff158c4bee13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '62cc3504f572430e138937785a1af3df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5ea2c5ab2d104730b93c0bcb623882d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '742f294364b036a6bf55d9b80f53ef5d1f72feebff7cf09ebec62fe7b5410de4d211c202af3e1f77234122711a4fefbe897edc36ee08ec73f98fc5e33a171522', 'id': 'c7eb792f-211b-4ae6-864b-ff158c4bee13', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c7eb792f-211b-4ae6-864b-ff158c4bee13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46d4b68-5c2b-4e46-bdc9-21fbb0fd0de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Volume volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 (38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013): created successfully Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46d4b68-5c2b-4e46-bdc9-21fbb0fd0de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Flow 'volume_create_manager' (a43d04dc-e781-4f4c-bf4e-47d248ee769f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-637f2788-635c-4372-a6ba-d6615b47d0c5 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Created volume successfully. Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Acquiring lock "cinder-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "cinder-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Acquiring lock "cinder-quobyte-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "cinder-quobyte-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e6fbd8-92a6-4fd8-ba7c-f5d7e07efd6a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:51 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 Jul 16 13:04:51 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:51 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:51 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013 Jul 16 13:04:51 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:51 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "cinder-quobyte-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013" released by "delete_volume" :: held 0.650s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:51 devstack cinder-volume[87560]: WARNING cinder.quota [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:51 devstack cinder-volume[87560]: WARNING cinder.quota [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 16 13:04:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Created reservations ['e3e4be10-35dd-4933-90a4-28e12a2758c4', 'fb0951a6-c86b-4e93-9084-76e0ca73541b', '35c6849f-4de6-483d-9f60-0af23f99ad9e', '14901fb8-1e02-4071-b64d-8713133c12c0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:52 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:04:52 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:52 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:04:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Deleted volume successfully. Jul 16 13:04:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b236489b-b947-472c-9b8d-63648c595e61 tempest-VolumeAndVolumeTypeFromImageTest-1390433175 None] Lock "cinder-38f7fd80-ee8f-4e72-a1c8-db0ef6f3d013-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Flow 'volume_create_manager' (65ab05d1-55a2-4d08-9db6-cd7305c9556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1456aab-6ab3-4320-8989-3e929a31121b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1456aab-6ab3-4320-8989-3e929a31121b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69673aa528594461bc7d17fb539867a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:59Z,use_quota=True,user_id='ed2d97b4edb84fe681e9dcdfb88f4670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc1a362-809d-41b9-b697-be87287d92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc1a362-809d-41b9-b697-be87287d92d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a857efa9-2fcf-4900-a870-f8692473836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a857efa9-2fcf-4900-a870-f8692473836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe', 'volume_name': 'volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe', 'volume_size': 1, 'image_id': '688f0e05-90d9-4272-9603-46070eca0011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd200d2a3e4218b6f784456331a9a79bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69673aa528594461bc7d17fb539867a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e3fb9dd929d8a4bf3b76694f9f474127335d46846eba963b06da7e2b834bfbbaf34c45da1e7272b3634355a905e53e6a02f23fd312e9bdd36438b0b037bc38', 'id': '688f0e05-90d9-4272-9603-46070eca0011', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688f0e05-90d9-4272-9603-46070eca0011/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc80b51-c647-4dc1-816d-b7e4bdb1bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc80b51-c647-4dc1-816d-b7e4bdb1bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d03f3a-fa1b-499c-91f8-6606ae9c62cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:04:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe', 'volume_size': 1, 'image_id': '688f0e05-90d9-4272-9603-46070eca0011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd200d2a3e4218b6f784456331a9a79bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69673aa528594461bc7d17fb539867a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e3fb9dd929d8a4bf3b76694f9f474127335d46846eba963b06da7e2b834bfbbaf34c45da1e7272b3634355a905e53e6a02f23fd312e9bdd36438b0b037bc38', 'id': '688f0e05-90d9-4272-9603-46070eca0011', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688f0e05-90d9-4272-9603-46070eca0011/file', 'properties': {}}, 'image_service': } Jul 16 13:04:58 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Trying to clone 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe from image 688f0e05-90d9-4272-9603-46070eca0011 at location (None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:04:59 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Image download 0.00 MB at 0.00 MB/s Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e22f35-3bd9-4350-b201-be900ae64c0f]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:59 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:04:59 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:59 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:59 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:04:59 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:04:59 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Temporary image 688f0e05-90d9-4272-9603-46070eca0011 is fetched for user ed2d97b4edb84fe681e9dcdfb88f4670. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e638dc-8920-4967-a895-55d56c0fee6d]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:04:59 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:04:59 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:00 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:00 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:05:00 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:00 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69673aa528594461bc7d17fb539867a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:04:59Z,use_quota=True,user_id='ed2d97b4edb84fe681e9dcdfb88f4670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Creating volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:05:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:00 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1073741824 Jul 16 13:05:00 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:00 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1073741824" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:00 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe Jul 16 13:05:00 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:01 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Attempting download of 688f0e05-90d9-4272-9603-46070eca0011 ((None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}])) to volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18a4491-a5f4-4869-a90d-3841582ce187]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:01 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3 Jul 16 13:05:01 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:01 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:01 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3 Jul 16 13:05:01 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:01 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3" returned: 1 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_688f0e05-90d9-4272-9603-46070eca0011_qfyyakj3' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c2ba4b-94d4-4b36-8a12-1d1fd7fac2ff]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:01 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:05:01 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:02 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:02 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD Jul 16 13:05:02 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:02 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] 688f0e05-90d9-4272-9603-46070eca0011 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:02 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe Jul 16 13:05:02 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:02 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" returned: 0 in 0.442s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_688f0e05-90d9-4272-9603-46070eca0011_los78z3adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:05:02 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 13:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:03 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1G Jul 16 13:05:03 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:03 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe 1G" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Downloaded image 688f0e05-90d9-4272-9603-46070eca0011 ((None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}])) to volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Temporary image 688f0e05-90d9-4272-9603-46070eca0011 for user ed2d97b4edb84fe681e9dcdfb88f4670 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Marking volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=83,cinder:INSERT=30,cinder:UPDATE=97,cinder:DELETE=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Copying metadata from image 688f0e05-90d9-4272-9603-46070eca0011 to 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Creating volume glance metadata for volume 4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe backed by image 688f0e05-90d9-4272-9603-46070eca0011 with: {'image_id': '688f0e05-90d9-4272-9603-46070eca0011', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd200d2a3e4218b6f784456331a9a79bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=70,cinder:UPDATE=96,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d03f3a-fa1b-499c-91f8-6606ae9c62cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe', 'volume_size': 1, 'image_id': '688f0e05-90d9-4272-9603-46070eca0011', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/688f0e05-90d9-4272-9603-46070eca0011', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd200d2a3e4218b6f784456331a9a79bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69673aa528594461bc7d17fb539867a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35e3fb9dd929d8a4bf3b76694f9f474127335d46846eba963b06da7e2b834bfbbaf34c45da1e7272b3634355a905e53e6a02f23fd312e9bdd36438b0b037bc38', 'id': '688f0e05-90d9-4272-9603-46070eca0011', 'created_at': datetime.datetime(2026, 7, 16, 11, 4, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 4, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/688f0e05-90d9-4272-9603-46070eca0011/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af30b9-4e4d-4d2b-894d-0e950d8f58c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Volume volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe (4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe): created successfully Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af30b9-4e4d-4d2b-894d-0e950d8f58c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Flow 'volume_create_manager' (65ab05d1-55a2-4d08-9db6-cd7305c9556e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b7002246-f201-48ed-8ef5-b7105096323f tempest-VolumeImageDependencyTests-1430490702 None] Created volume successfully. Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Acquiring lock "cinder-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "cinder-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Acquiring lock "cinder-quobyte-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "cinder-quobyte-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a9fcd-f924-4ace-8374-6f76079b9218]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:04 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe Jul 16 13:05:04 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:04 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:04 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe Jul 16 13:05:04 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:04 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "cinder-quobyte-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe" released by "delete_volume" :: held 0.643s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Created reservations ['81fcdf49-006c-4e10-bab3-7fb1df83e2e2', 'b55db115-d8cc-4e61-8c01-e50cf99c907f', '76b82b46-ab16-4707-adad-057d6b305c58', '43cf85ac-7c6d-4bd5-b087-e53815d4a8fb'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:04 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:04 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:04 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:04 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Deleted volume successfully. Jul 16 13:05:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c15f5fde-4ef1-4f28-afa9-c2f5e6053154 tempest-VolumeImageDependencyTests-1430490702 None] Lock "cinder-4c9e6299-9ae3-434f-9e8d-7ecdf3de29fe-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Flow 'volume_create_manager' (173f73b5-fdd9-4f47-af99-c41c2df06b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60534a86-9565-4129-ab56-cc88bc0eb6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60534a86-9565-4129-ab56-cc88bc0eb6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847320cc-7f95-44f5-af94-bc438d5d6de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6494e3cf945f4ff9b692bd67737ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:08Z,use_quota=True,user_id='1a570e5a07f645c7bbd366a60aed2762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c288981-5e91-4981-b830-f5034fb08a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c288981-5e91-4981-b830-f5034fb08a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda16b0-db0c-4113-a442-47f31dfb9488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bda16b0-db0c-4113-a442-47f31dfb9488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847320cc-7f95-44f5-af94-bc438d5d6de0', 'volume_name': 'volume-847320cc-7f95-44f5-af94-bc438d5d6de0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d341b696-501d-4684-a28c-a524cefce34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d341b696-501d-4684-a28c-a524cefce34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9d30ba-2a3e-4e9b-b5dd-2a9157103320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Volume 847320cc-7f95-44f5-af94-bc438d5d6de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847320cc-7f95-44f5-af94-bc438d5d6de0', 'volume_size': 1} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847320cc-7f95-44f5-af94-bc438d5d6de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6494e3cf945f4ff9b692bd67737ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:08Z,use_quota=True,user_id='1a570e5a07f645c7bbd366a60aed2762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Creating volume 847320cc-7f95-44f5-af94-bc438d5d6de0 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:05:08 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:08 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 1073741824 Jul 16 13:05:08 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:08 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 1073741824" returned: 0 in 0.413s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:08 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 Jul 16 13:05:08 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:08 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:08 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:08 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c9d30ba-2a3e-4e9b-b5dd-2a9157103320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847320cc-7f95-44f5-af94-bc438d5d6de0', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984015bc-4c68-474e-a1a1-b113973b3f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Volume volume-847320cc-7f95-44f5-af94-bc438d5d6de0 (847320cc-7f95-44f5-af94-bc438d5d6de0): created successfully Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984015bc-4c68-474e-a1a1-b113973b3f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Flow 'volume_create_manager' (173f73b5-fdd9-4f47-af99-c41c2df06b91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-101d66c5-2438-49c2-a302-27a8c8566ec3 tempest-CinderUnicodeTest-696184477 None] Created volume successfully. Jul 16 13:05:09 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 29 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Flow 'volume_create_manager' (d9e3d441-580e-4430-b24c-7ae67faf0eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a34920-2d7c-4fba-821a-a8863b48b9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a34920-2d7c-4fba-821a-a8863b48b9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-948932732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18d8343-9c97-4fe6-8617-32e50ffa6f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6494e3cf945f4ff9b692bd67737ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:10Z,use_quota=True,user_id='1a570e5a07f645c7bbd366a60aed2762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dd5c91-05ff-40e1-a5ba-255c25f297c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dd5c91-05ff-40e1-a5ba-255c25f297c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91085816-12df-4626-91ed-7b1126540277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91085816-12df-4626-91ed-7b1126540277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c18d8343-9c97-4fe6-8617-32e50ffa6f65', 'volume_name': 'volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bd85f2-8563-4200-8b6f-04c74671184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bd85f2-8563-4200-8b6f-04c74671184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2e0e69-e4b8-4bba-b3e8-6e1d2ec64b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Volume c18d8343-9c97-4fe6-8617-32e50ffa6f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65', 'volume_size': 1} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-948932732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c18d8343-9c97-4fe6-8617-32e50ffa6f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6494e3cf945f4ff9b692bd67737ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:10Z,use_quota=True,user_id='1a570e5a07f645c7bbd366a60aed2762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Creating volume c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:05:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:09 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 1073741824 Jul 16 13:05:09 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:10 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 1073741824" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:10 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 Jul 16 13:05:10 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:10 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2e0e69-e4b8-4bba-b3e8-6e1d2ec64b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0970e361-f2c0-4ecb-8b57-fa18b3fb299e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Volume volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 (c18d8343-9c97-4fe6-8617-32e50ffa6f65): created successfully Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0970e361-f2c0-4ecb-8b57-fa18b3fb299e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Flow 'volume_create_manager' (d9e3d441-580e-4430-b24c-7ae67faf0eaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-97903d16-26ad-4912-9b8e-ec689b393c83 tempest-CinderUnicodeTest-696184477 None] Created volume successfully. Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Creating offline snapshot 67060dce-6b32-46f1-90e3-0be6465ab2a3 of volume c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4527b34-7eae-4be5-967d-0a0ef2ff5a88]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:11 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 Jul 16 13:05:11 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:11 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:11 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 1G Jul 16 13:05:11 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:11 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 1G" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:11 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 Jul 16 13:05:11 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:11 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 is being set with open permissions: ugo+rw Jul 16 13:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:12 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 Jul 16 13:05:12 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:12 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:12 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info Jul 16 13:05:12 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:12 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:12 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info is being set with open permissions: ugo+rw Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:12 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info Jul 16 13:05:12 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:12 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.info" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-78421f42-bfea-4acf-96da-2529cb2a2f8e tempest-CinderUnicodeTest-696184477 None] Create snapshot completed successfully Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-67060dce-6b32-46f1-90e3-0be6465ab2a3-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-67060dce-6b32-46f1-90e3-0be6465ab2a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-quobyte-67060dce-6b32-46f1-90e3-0be6465ab2a3" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-67060dce-6b32-46f1-90e3-0be6465ab2a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Deleting offline snapshot 67060dce-6b32-46f1-90e3-0be6465ab2a3 of volume c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] snapshot_file for this snap is: volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6d02a6-98fe-4679-95ac-2cc19c12b714]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:13 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 Jul 16 13:05:13 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:13 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca5475c-d8ba-4e2f-a035-c4ddaa1ca395]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:13 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 Jul 16 13:05:13 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:13 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:13 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 Jul 16 13:05:13 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:14 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:14 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3 Jul 16 13:05:14 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:14 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65.67060dce-6b32-46f1-90e3-0be6465ab2a3" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-67060dce-6b32-46f1-90e3-0be6465ab2a3" released by "_delete_snapshot" :: held 1.374s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" released by "delete_snapshot" :: held 1.396s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Created reservations ['8e246879-3a4c-4171-9a07-ec515cee9cdc', 'f2aa36b7-f223-40f2-bdc0-80eaac566062', '4559122f-3c08-4255-8d8d-2d78e8c8ef0a', 'db835cdc-7d5e-4368-9f78-3c3fdc87a8dd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Delete snapshot completed successfully. Jul 16 13:05:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ffc3b07-340d-4c60-bd78-32ca105e2cba tempest-CinderUnicodeTest-696184477 None] Lock "cinder-67060dce-6b32-46f1-90e3-0be6465ab2a3-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-c18d8343-9c97-4fe6-8617-32e50ffa6f65-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-c18d8343-9c97-4fe6-8617-32e50ffa6f65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[34601524-9be1-41b8-a35b-2ecabbadc6be]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:15 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 Jul 16 13:05:15 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:15 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:15 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65 Jul 16 13:05:15 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:15 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c18d8343-9c97-4fe6-8617-32e50ffa6f65" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-c18d8343-9c97-4fe6-8617-32e50ffa6f65" released by "delete_volume" :: held 0.677s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Created reservations ['8b2bfbc1-34b3-4a40-aaa2-7be62ac5b0c5', '39c26dfb-f404-42ea-9fa2-f27307adfe65', '86030d33-9713-4859-8624-1d3d11700eaa', '72af6a2b-2e17-4397-a6a7-67667490296b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:16 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:16 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:16 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Deleted volume successfully. Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d6ed2cbb-a1d1-4c1b-ad9a-629b03aae649 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-c18d8343-9c97-4fe6-8617-32e50ffa6f65-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-847320cc-7f95-44f5-af94-bc438d5d6de0-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-847320cc-7f95-44f5-af94-bc438d5d6de0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "cinder-quobyte-847320cc-7f95-44f5-af94-bc438d5d6de0" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-847320cc-7f95-44f5-af94-bc438d5d6de0" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1564c6-dbdf-4938-a499-81d8931e0a1c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:16 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 Jul 16 13:05:16 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:16 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0" returned: 0 in 0.374s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:16 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0 Jul 16 13:05:16 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:17 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-847320cc-7f95-44f5-af94-bc438d5d6de0" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-quobyte-847320cc-7f95-44f5-af94-bc438d5d6de0" released by "delete_volume" :: held 0.665s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Created reservations ['589350c1-1c34-440d-8653-1fc1086af48d', 'a59a23bd-8583-40f0-b807-eb82c263a0d6', '49ad6ccd-0068-4113-bc28-7667bac6aeff', 'e465eb06-86b6-4ef0-a2ce-6f2eed8b1b85'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:17 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:17 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:17 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Deleted volume successfully. Jul 16 13:05:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d32ad7c1-9906-4e54-9ed3-56edbbda2d22 tempest-CinderUnicodeTest-696184477 None] Lock "cinder-847320cc-7f95-44f5-af94-bc438d5d6de0-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:27 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=35,cinder:INSERT=17,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:05:27 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=29,cinder:UPDATE=38,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Flow 'volume_create_manager' (5d54ad33-2187-4e89-898b-c303b2e8b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4743f3aa-77be-4275-a040-9d1c97574bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4743f3aa-77be-4275-a040-9d1c97574bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1670459801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e249798-84b6-4580-b224-4de38f9c36c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33efd3fd9984109a1098f7f3f51e04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:37Z,use_quota=True,user_id='55fe93e42c10416d8d9ca2f0bb3f62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4508e6f-4e72-44a6-9b46-cf85869214c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4508e6f-4e72-44a6-9b46-cf85869214c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1cb2a-74bc-47b9-a4ef-f50e55625f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1cb2a-74bc-47b9-a4ef-f50e55625f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e249798-84b6-4580-b224-4de38f9c36c8', 'volume_name': 'volume-8e249798-84b6-4580-b224-4de38f9c36c8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3743bc30-bcfc-43af-933e-fd77a57857de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3743bc30-bcfc-43af-933e-fd77a57857de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa62bf7a-bea7-4b23-b7d4-868f8db049cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Volume 8e249798-84b6-4580-b224-4de38f9c36c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e249798-84b6-4580-b224-4de38f9c36c8', 'volume_size': 1} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1670459801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e249798-84b6-4580-b224-4de38f9c36c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33efd3fd9984109a1098f7f3f51e04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:37Z,use_quota=True,user_id='55fe93e42c10416d8d9ca2f0bb3f62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Creating volume 8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:05:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:05:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:36 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 1073741824 Jul 16 13:05:36 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:37 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 1073741824" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:37 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:37 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:37 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa62bf7a-bea7-4b23-b7d4-868f8db049cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e249798-84b6-4580-b224-4de38f9c36c8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e85656e-00af-4863-a057-8a944295a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Volume volume-8e249798-84b6-4580-b224-4de38f9c36c8 (8e249798-84b6-4580-b224-4de38f9c36c8): created successfully Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e85656e-00af-4863-a057-8a944295a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Flow 'volume_create_manager' (5d54ad33-2187-4e89-898b-c303b2e8b942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-161b63a6-bf2d-4d77-b98a-61d3b64ae199 tempest-SnapshotDependencyTests-443900067 None] Created volume successfully. Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Creating offline snapshot 8953e2d4-159c-4ae6-9233-3b58e5510ae2 of volume 8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeed043-a5e7-41f6-b647-8ed5636beed2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:38 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:38 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:38 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:38 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 1G Jul 16 13:05:38 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:38 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 1G" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e249798-84b6-4580-b224-4de38f9c36c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:38 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e249798-84b6-4580-b224-4de38f9c36c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:38 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:38 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e249798-84b6-4580-b224-4de38f9c36c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 is being set with open permissions: ugo+rw Jul 16 13:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:38 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:38 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:39 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:39 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info Jul 16 13:05:39 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:39 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:39 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info is being set with open permissions: ugo+rw Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:39 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info Jul 16 13:05:39 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:39 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.info" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b4d08f5d-52af-4ac4-b6d9-9007626774b7 tempest-SnapshotDependencyTests-443900067 None] Create snapshot completed successfully Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Flow 'volume_create_manager' (176518c8-acb3-490e-864a-697816c2906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5baead-7b1b-4e2b-aeab-e3836e465ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5baead-7b1b-4e2b-aeab-e3836e465ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d17d4c6-4170-49cf-aadd-6a079d825950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33efd3fd9984109a1098f7f3f51e04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8953e2d4-159c-4ae6-9233-3b58e5510ae2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:05:40Z,use_quota=True,user_id='55fe93e42c10416d8d9ca2f0bb3f62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba5ab2c-8f91-4a53-a34e-4a68750e8ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba5ab2c-8f91-4a53-a34e-4a68750e8ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d601da48-ddf9-4e72-a47a-ab284d0048d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d601da48-ddf9-4e72-a47a-ab284d0048d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d17d4c6-4170-49cf-aadd-6a079d825950', 'volume_name': 'volume-5d17d4c6-4170-49cf-aadd-6a079d825950', 'volume_size': 1, 'snapshot_id': '8953e2d4-159c-4ae6-9233-3b58e5510ae2'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd8de3e-7eb2-417b-8ad9-cd6b7c978869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd8de3e-7eb2-417b-8ad9-cd6b7c978869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec25a7a4-4dde-40f2-bad0-455c6b83c6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Volume 5d17d4c6-4170-49cf-aadd-6a079d825950: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d17d4c6-4170-49cf-aadd-6a079d825950', 'volume_size': 1, 'snapshot_id': '8953e2d4-159c-4ae6-9233-3b58e5510ae2'} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2-5d17d4c6-4170-49cf-aadd-6a079d825950" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2-5d17d4c6-4170-49cf-aadd-6a079d825950" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Creating volume 5d17d4c6-4170-49cf-aadd-6a079d825950 from snapshot 8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] snapshot: 8953e2d4-159c-4ae6-9233-3b58e5510ae2, volume: 5d17d4c6-4170-49cf-aadd-6a079d825950, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df6f94-cb09-4798-ac4a-77a35ff031ae]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:40 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:40 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:41 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e249798-84b6-4580-b224-4de38f9c36c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9649ff5d-2665-4ab4-ae7e-37ef208a13be]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:41 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:41 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:41 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:41 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 Jul 16 13:05:41 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:45 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950" returned: 0 in 4.162s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66190d7-0da3-457e-910e-a7ad871300c0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:45 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:45 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:46 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8, size 1024.00 MB, duration 4.16 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:05:46 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Converted 1024.00 MB image at 245.95 MB/s Jul 16 13:05:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 is being set with open permissions: ugo+rw Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:46 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 Jul 16 13:05:46 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:46 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" released by "_copy_volume_from_snapshot" :: held 5.750s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2-5d17d4c6-4170-49cf-aadd-6a079d825950" released by "_create_volume_from_snapshot" :: held 5.776s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.793s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec25a7a4-4dde-40f2-bad0-455c6b83c6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d17d4c6-4170-49cf-aadd-6a079d825950', 'volume_size': 1, 'snapshot_id': '8953e2d4-159c-4ae6-9233-3b58e5510ae2'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6f4f4c-5be7-429e-af08-800ff16f217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:05:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Volume volume-5d17d4c6-4170-49cf-aadd-6a079d825950 (5d17d4c6-4170-49cf-aadd-6a079d825950): created successfully Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6f4f4c-5be7-429e-af08-800ff16f217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:05:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Flow 'volume_create_manager' (176518c8-acb3-490e-864a-697816c2906a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:05:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-007a7a09-743a-4987-a63d-3d1e9bbb89aa tempest-SnapshotDependencyTests-443900067 None] Created volume successfully. Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-8953e2d4-159c-4ae6-9233-3b58e5510ae2-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-8953e2d4-159c-4ae6-9233-3b58e5510ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Deleting offline snapshot 8953e2d4-159c-4ae6-9233-3b58e5510ae2 of volume 8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] snapshot_file for this snap is: volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[007b3bdf-e0c2-45e2-a4d1-3f20f8a54cd8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:47 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:47 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:47 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e249798-84b6-4580-b224-4de38f9c36c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f73e7-3306-47e2-a089-6f4d09ca30eb]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:47 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:47 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:47 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:47 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:47 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:48 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:48 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2 Jul 16 13:05:48 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:48 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8.8953e2d4-159c-4ae6-9233-3b58e5510ae2" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8953e2d4-159c-4ae6-9233-3b58e5510ae2" released by "_delete_snapshot" :: held 1.371s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" released by "delete_snapshot" :: held 1.392s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Created reservations ['8737b540-278c-4c37-bc11-b03508e419a0', '88b8bb4b-eafe-4132-b1b3-b8754975688a', 'fcb7b7e3-946b-4cb2-898c-ec372ff05a4c', '3f10e049-7ef6-4861-b2d4-599223856926'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Delete snapshot completed successfully. Jul 16 13:05:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3110359a-9b64-46ad-890d-9865f6ef489f tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-8953e2d4-159c-4ae6-9233-3b58e5510ae2-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-8e249798-84b6-4580-b224-4de38f9c36c8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-8e249798-84b6-4580-b224-4de38f9c36c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe56f4b-27e2-4256-9fe4-c8655f39b837]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:49 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:49 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:49 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:49 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8 Jul 16 13:05:49 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:50 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8e249798-84b6-4580-b224-4de38f9c36c8" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-8e249798-84b6-4580-b224-4de38f9c36c8" released by "delete_volume" :: held 0.647s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Created reservations ['05c6a3fa-7609-4bda-9cb6-122211992e54', '44854d8d-a445-4caf-9dac-ca7085263939', '20676d35-2bfd-4bae-af93-b3160d61a019', 'd09ce91c-3309-4d55-8d6b-23d061f17bba'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:50 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:50 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:50 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Deleted volume successfully. Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ab288184-024c-4b3e-9899-e9d93ba4e59d tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-8e249798-84b6-4580-b224-4de38f9c36c8-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-5d17d4c6-4170-49cf-aadd-6a079d825950-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-5d17d4c6-4170-49cf-aadd-6a079d825950-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27f043d-9db2-4363-b45e-5e75e5a3b320]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:50 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 Jul 16 13:05:50 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:50 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:50 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950 Jul 16 13:05:50 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:51 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-5d17d4c6-4170-49cf-aadd-6a079d825950" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-quobyte-5d17d4c6-4170-49cf-aadd-6a079d825950" released by "delete_volume" :: held 0.642s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Created reservations ['68953383-79ae-4d39-af5c-697385f7453b', '43783496-3718-4856-be56-a6738c460c1d', '887232d3-f1a5-4b63-8ab4-beb82b3f33dc', '74e8eed7-c146-4b92-a308-4e29c7fe64da'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:05:51 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:05:51 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:05:51 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:05:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Deleted volume successfully. Jul 16 13:05:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-586bfedf-06b4-4df1-896f-d1f99c1262cc tempest-SnapshotDependencyTests-443900067 None] Lock "cinder-5d17d4c6-4170-49cf-aadd-6a079d825950-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:01 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:06:01 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=26,cinder:SELECT=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:08 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:08 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:09 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 29 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (e72e491c-4aad-4687-a58b-20cb40a75a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede8371-73c7-4930-b757-9fedb42489cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ede8371-73c7-4930-b757-9fedb42489cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255339207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c23493a-143c-48b7-bb9e-3f3e8cfa9dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89ae7f-76b2-4a1d-bb51-573301f23d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b89ae7f-76b2-4a1d-bb51-573301f23d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d2edde-282c-4bce-885d-87788dfdb6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d2edde-282c-4bce-885d-87788dfdb6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c23493a-143c-48b7-bb9e-3f3e8cfa9dae', 'volume_name': 'volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c18bd5-4495-4e85-8f54-8fb0c6d123e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c18bd5-4495-4e85-8f54-8fb0c6d123e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10714050-9626-454f-8cb2-9decac3f7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Volume 0c23493a-143c-48b7-bb9e-3f3e8cfa9dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae', 'volume_size': 1} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1255339207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c23493a-143c-48b7-bb9e-3f3e8cfa9dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Creating volume 0c23493a-143c-48b7-bb9e-3f3e8cfa9dae {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:10 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:10 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae 1073741824 Jul 16 13:06:10 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (327454f7-1a1b-4b0f-87dc-3f3612477266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd5130d-9e76-48af-b816-9fdcc4ff47b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd5130d-9e76-48af-b816-9fdcc4ff47b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861547879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d5bb75-959d-419a-8bb4-13e63d580cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e665c-31cc-4c66-90a2-206cdc7f0e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4e665c-31cc-4c66-90a2-206cdc7f0e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e085795-50a9-4652-baa7-251bee9bfdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e085795-50a9-4652-baa7-251bee9bfdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d5bb75-959d-419a-8bb4-13e63d580cc7', 'volume_name': 'volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660dc2de-219a-4869-8144-56d924096cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660dc2de-219a-4869-8144-56d924096cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc7e3c3-3fbf-4ac3-8f2c-fe04b67393a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume a1d5bb75-959d-419a-8bb4-13e63d580cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7', 'volume_size': 1} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (bfa1c834-1eae-480d-901c-47c91d1a3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1719596d-82d2-405f-8692-745ee237ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1719596d-82d2-405f-8692-745ee237ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482613661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13937132-378c-4cad-8e87-31ab9d94a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13937132-378c-4cad-8e87-31ab9d94a342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa2da29-5d0e-4e8e-9687-6cebf13e0066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faa2da29-5d0e-4e8e-9687-6cebf13e0066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58', 'volume_name': 'volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67688987-d9b2-4240-8c92-b81f9bafc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67688987-d9b2-4240-8c92-b81f9bafc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12aa737-6698-485d-a175-881de9670bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Volume 99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58', 'volume_size': 1} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:10 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae 1073741824" returned: 0 in 0.660s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:10 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae Jul 16 13:06:10 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:11 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (3a92f239-7ec7-4b10-9f71-bff367127bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b55078-b5e7-4f99-acd4-9434166d706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-861547879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d5bb75-959d-419a-8bb4-13e63d580cc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume a1d5bb75-959d-419a-8bb4-13e63d580cc7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b55078-b5e7-4f99-acd4-9434166d706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323405864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420e4d9f-8cf9-465d-99e1-14b30b156c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:11Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8043e8-fb94-4736-9370-24f14b6c8e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 1073741824 Jul 16 13:06:11 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8043e8-fb94-4736-9370-24f14b6c8e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27e1d79-8013-4d01-a3e5-607f6d8d75e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27e1d79-8013-4d01-a3e5-607f6d8d75e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420e4d9f-8cf9-465d-99e1-14b30b156c4f', 'volume_name': 'volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236c3cb-7160-4509-933f-6fa41b4596df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7236c3cb-7160-4509-933f-6fa41b4596df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d75f015-5e2b-45d9-8335-46ad80f805d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Volume 420e4d9f-8cf9-465d-99e1-14b30b156c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f', 'volume_size': 1} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10714050-9626-454f-8cb2-9decac3f7242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92fb79c-38ea-4abe-b165-0cb1da31f5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Volume volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae (0c23493a-143c-48b7-bb9e-3f3e8cfa9dae): created successfully Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92fb79c-38ea-4abe-b165-0cb1da31f5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (e72e491c-4aad-4687-a58b-20cb40a75a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e823bb8e-821e-43de-856d-46aaf6ec4d2c tempest-CreateVolumesFromImageTest-2114526057 None] Created volume successfully. Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (3d4ab2e5-ca04-456a-adb4-68fcb0efafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735872ce-4f5b-4fde-8a97-949aee8980c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735872ce-4f5b-4fde-8a97-949aee8980c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411103463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a347c9-d3c1-4919-b73d-86f26ccdf64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:11Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5ece21-b9d0-4e50-b68d-85e4068f0e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5ece21-b9d0-4e50-b68d-85e4068f0e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe36c19-f902-4c88-a081-fe81db6597f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe36c19-f902-4c88-a081-fe81db6597f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a347c9-d3c1-4919-b73d-86f26ccdf64a', 'volume_name': 'volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c38e7b-2ef1-4d98-a74b-d8e721610b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c38e7b-2ef1-4d98-a74b-d8e721610b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee27b56e-8b3b-4566-b322-2ac516b3c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Volume 05a347c9-d3c1-4919-b73d-86f26ccdf64a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a', 'volume_size': 1} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (9bbffb38-692c-4af7-8771-692092b977b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108f7215-0d41-4de7-a2a5-573f9cde580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (108f7215-0d41-4de7-a2a5-573f9cde580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377296553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc920a27-8e15-4c95-89cd-356df07a29e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:12Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229d6f2-3f65-47e5-a4d9-ce99def39152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229d6f2-3f65-47e5-a4d9-ce99def39152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521189ed-5a5e-4bb3-850e-5d60afcf811f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521189ed-5a5e-4bb3-850e-5d60afcf811f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc920a27-8e15-4c95-89cd-356df07a29e2', 'volume_name': 'volume-dc920a27-8e15-4c95-89cd-356df07a29e2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35806c51-b0bc-400c-9dc4-67bef674fe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35806c51-b0bc-400c-9dc4-67bef674fe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e6ee2b-c36b-41ea-9013-77ae5ec9987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Volume dc920a27-8e15-4c95-89cd-356df07a29e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc920a27-8e15-4c95-89cd-356df07a29e2', 'volume_size': 1} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:11 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 1073741824" returned: 0 in 0.624s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:11 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 Jul 16 13:06:11 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:12 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-482613661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:10Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Creating volume 99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:12 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 1073741824 Jul 16 13:06:12 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc7e3c3-3fbf-4ac3-8f2c-fe04b67393a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34542eb-afbd-4503-b7ec-5a0b4c61f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 (a1d5bb75-959d-419a-8bb4-13e63d580cc7): created successfully Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34542eb-afbd-4503-b7ec-5a0b4c61f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (327454f7-1a1b-4b0f-87dc-3f3612477266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-69462efd-ca91-4235-8c9f-228624aa6ebc tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:12 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 1073741824" returned: 0 in 0.555s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:12 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 Jul 16 13:06:12 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:13 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1323405864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420e4d9f-8cf9-465d-99e1-14b30b156c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:11Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Creating volume 420e4d9f-8cf9-465d-99e1-14b30b156c4f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12aa737-6698-485d-a175-881de9670bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:13 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f 1073741824 Jul 16 13:06:13 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0d8f26-1b18-4c4f-bd84-f4b6a84dae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Volume volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 (99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58): created successfully Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0d8f26-1b18-4c4f-bd84-f4b6a84dae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (bfa1c834-1eae-480d-901c-47c91d1a3e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7dd7b52b-8652-42dd-9fc2-9d01add81a9a tempest-CreateVolumesFromImageTest-2114526057 None] Created volume successfully. Jul 16 13:06:13 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f 1073741824" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:13 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f Jul 16 13:06:13 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:13 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f" returned: 0 in 0.422s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411103463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a347c9-d3c1-4919-b73d-86f26ccdf64a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:11Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Creating volume 05a347c9-d3c1-4919-b73d-86f26ccdf64a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:14 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a 1073741824 Jul 16 13:06:14 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d75f015-5e2b-45d9-8335-46ad80f805d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36c8c50-6308-4dda-bf0f-9594081fe074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (f9c2e71a-2ba6-4683-a6df-8c251f9bd930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb49f6a-347e-4d54-8178-7ce16b242f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb49f6a-347e-4d54-8178-7ce16b242f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-451622152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46abbd3-027f-4cb9-9178-e3f0fff6d3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:14Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff17d765-a4c3-47f5-9ecd-34c025bbf774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff17d765-a4c3-47f5-9ecd-34c025bbf774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e2b7b7-b5bd-4dda-abc3-a18b703180d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e2b7b7-b5bd-4dda-abc3-a18b703180d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c46abbd3-027f-4cb9-9178-e3f0fff6d3be', 'volume_name': 'volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750f6df8-bbfb-4048-aa60-ddb844166605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (750f6df8-bbfb-4048-aa60-ddb844166605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6323d83-5127-4661-8cd5-9c6d0b24f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume c46abbd3-027f-4cb9-9178-e3f0fff6d3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be', 'volume_size': 1} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Volume volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f (420e4d9f-8cf9-465d-99e1-14b30b156c4f): created successfully Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36c8c50-6308-4dda-bf0f-9594081fe074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (3a92f239-7ec7-4b10-9f71-bff367127bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef385249-2af8-421e-88ce-b4bd86c87ddf tempest-CreateVolumesFromImageTest-2114526057 None] Created volume successfully. Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (8324b08d-8e73-43ce-9e11-e26149730e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9464c47-0c91-4cc8-9160-a69083092544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9464c47-0c91-4cc8-9160-a69083092544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254244840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8fae20-166d-410c-8305-c63acb60020b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:14Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8d3fad-1630-4c6e-b3b1-0ab84399af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8d3fad-1630-4c6e-b3b1-0ab84399af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588637ab-85e6-435b-9d62-3640c41b2747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588637ab-85e6-435b-9d62-3640c41b2747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8fae20-166d-410c-8305-c63acb60020b', 'volume_name': 'volume-ed8fae20-166d-410c-8305-c63acb60020b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0febd6-b2f1-42fd-b09f-d2e9785d5f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0febd6-b2f1-42fd-b09f-d2e9785d5f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b77190-3247-4a83-bdd0-90759887034c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume ed8fae20-166d-410c-8305-c63acb60020b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8fae20-166d-410c-8305-c63acb60020b', 'volume_size': 1} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:14 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a 1073741824" returned: 0 in 0.781s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:14 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a Jul 16 13:06:14 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Flow 'volume_create_manager' (6cdd1569-4c07-4873-a055-00f9095b3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3698e03-52cb-443b-9bea-837aafff3c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3698e03-52cb-443b-9bea-837aafff3c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df69a059-b856-444d-bb4b-8fd439429260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37277340bb47219e99ea473f91e67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:15Z,use_quota=True,user_id='ce81546f4fdb4255b529cceb78700ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0eb6541-494a-4395-97a0-1cea66bae67e),volume_type_id=a0eb6541-494a-4395-97a0-1cea66bae67e)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e05f69c-9040-478d-8439-deb888305962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e05f69c-9040-478d-8439-deb888305962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf09ae1c-a5bd-45ac-80bf-6412d4de461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:06:15 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.383s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377296553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc920a27-8e15-4c95-89cd-356df07a29e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1af9a04899246c7baa345613d3ba673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:12Z,use_quota=True,user_id='a5e10792a80249e085cf6a05245d8113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Creating volume dc920a27-8e15-4c95-89cd-356df07a29e2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee27b56e-8b3b-4566-b322-2ac516b3c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 1073741824 Jul 16 13:06:15 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a6c5ec-01ad-4909-aa17-92ea31bdcc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Volume volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a (05a347c9-d3c1-4919-b73d-86f26ccdf64a): created successfully Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a6c5ec-01ad-4909-aa17-92ea31bdcc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (3d4ab2e5-ca04-456a-adb4-68fcb0efafff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c0cfaaca-57eb-472b-aacc-55f7415e6998 tempest-CreateVolumesFromImageTest-2114526057 None] Created volume successfully. Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (a49a60a8-d46b-45f7-8ae5-c3a5bd38c97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210efc2f-f818-4419-ad2a-258250b12a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210efc2f-f818-4419-ad2a-258250b12a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163658401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd954a8e-6d4f-4456-904b-009f75dcfd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:15Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375dfdce-2afb-4051-928f-b940d007ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375dfdce-2afb-4051-928f-b940d007ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c270e-d57a-4496-aa86-159ca1494d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c270e-d57a-4496-aa86-159ca1494d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd954a8e-6d4f-4456-904b-009f75dcfd4e', 'volume_name': 'volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2015ad-7d13-4197-a976-b5a40988a54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2015ad-7d13-4197-a976-b5a40988a54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac6cbf-4c6c-4fb1-843b-56f5b0700d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume cd954a8e-6d4f-4456-904b-009f75dcfd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e', 'volume_size': 1} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf09ae1c-a5bd-45ac-80bf-6412d4de461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df69a059-b856-444d-bb4b-8fd439429260', 'volume_name': 'volume-df69a059-b856-444d-bb4b-8fd439429260', 'volume_size': 1, 'image_id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e215568df263521694a1cd0028d06ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc37277340bb47219e99ea473f91e67e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5931ac601e2dda82309d6f1df0008ac3c8bf1ed2f4d7a31daf1ffab5884eb9322b62115eed5d3a01993e4d0b61488b6fb65faf08528b7375c9e39dd75653a9f', 'id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d475e05d-e982-40d6-aab0-cc96ce5b316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d475e05d-e982-40d6-aab0-cc96ce5b316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902cad3d-4c5e-4876-a364-9fded58aa614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Volume df69a059-b856-444d-bb4b-8fd439429260: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df69a059-b856-444d-bb4b-8fd439429260', 'volume_size': 1, 'image_id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e215568df263521694a1cd0028d06ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc37277340bb47219e99ea473f91e67e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5931ac601e2dda82309d6f1df0008ac3c8bf1ed2f4d7a31daf1ffab5884eb9322b62115eed5d3a01993e4d0b61488b6fb65faf08528b7375c9e39dd75653a9f', 'id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Trying to clone df69a059-b856-444d-bb4b-8fd439429260 from image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (309b24b3-8990-4eed-a1cf-7c9c28e82d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:15 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe5bb45-c4cd-4403-9749-cc466aa9ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 1073741824" returned: 0 in 0.666s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Image download 0.00 MB at 0.00 MB/s Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe5bb45-c4cd-4403-9749-cc466aa9ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454002330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec3384-be17-4871-b191-8d120d17ba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:16Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56f8e97-4a03-4819-8ff5-156c131c6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56f8e97-4a03-4819-8ff5-156c131c6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b425ca-6580-48fc-8ddd-5b7997da59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b425ca-6580-48fc-8ddd-5b7997da59aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eec3384-be17-4871-b191-8d120d17ba5a', 'volume_name': 'volume-9eec3384-be17-4871-b191-8d120d17ba5a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3017012-e1ff-46c1-96f4-5df1341d7bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3017012-e1ff-46c1-96f4-5df1341d7bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99065390-96c8-4598-bcb0-7de9b5767d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume 9eec3384-be17-4871-b191-8d120d17ba5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eec3384-be17-4871-b191-8d120d17ba5a', 'volume_size': 1} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a443ea-8874-4cf6-bf9b-8a1b023fb9ba]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:16 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 Jul 16 13:06:16 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:16 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:16 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (ae3b1753-4d35-48e7-9e33-a0f7e5115615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251f2e3b-9898-467f-8f15-2d23c8e2f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251f2e3b-9898-467f-8f15-2d23c8e2f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1354402354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07527521-905c-46aa-a860-9339755a53a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:16Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e1ccb2-dd60-42fd-8d0f-ec0d6177d57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e1ccb2-dd60-42fd-8d0f-ec0d6177d57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d142e397-91a1-4c8b-8142-9c7b752d8bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d142e397-91a1-4c8b-8142-9c7b752d8bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07527521-905c-46aa-a860-9339755a53a1', 'volume_name': 'volume-07527521-905c-46aa-a860-9339755a53a1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c6edf-b88e-4ded-b9de-14a0c72c49b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c6edf-b88e-4ded-b9de-14a0c72c49b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0325d144-1815-49c1-bb3b-0c9d5ee18a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume 07527521-905c-46aa-a860-9339755a53a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07527521-905c-46aa-a860-9339755a53a1', 'volume_size': 1} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:16 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.110s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-451622152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46abbd3-027f-4cb9-9178-e3f0fff6d3be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:14Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume c46abbd3-027f-4cb9-9178-e3f0fff6d3be {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:16 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:16 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:16 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be 1073741824 Jul 16 13:06:16 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e6ee2b-c36b-41ea-9013-77ae5ec9987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc920a27-8e15-4c95-89cd-356df07a29e2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a8337-87bd-4b33-92d3-44f6ce48598a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Volume volume-dc920a27-8e15-4c95-89cd-356df07a29e2 (dc920a27-8e15-4c95-89cd-356df07a29e2): created successfully Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a8337-87bd-4b33-92d3-44f6ce48598a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Flow 'volume_create_manager' (9bbffb38-692c-4af7-8771-692092b977b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6787f0ef-c817-4174-aca1-327acec34a0b tempest-CreateVolumesFromImageTest-2114526057 None] Created volume successfully. Jul 16 13:06:16 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:16 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 1 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Temporary image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 is fetched for user ce81546f4fdb4255b529cceb78700ce8. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce0245-07c9-4065-b047-3a3b12846944]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:16 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be 1073741824" returned: 0 in 0.530s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-dc920a27-8e15-4c95-89cd-356df07a29e2-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-dc920a27-8e15-4c95-89cd-356df07a29e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:16 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be Jul 16 13:06:16 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-quobyte-dc920a27-8e15-4c95-89cd-356df07a29e2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:16 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:16 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-dc920a27-8e15-4c95-89cd-356df07a29e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716000c-ae6c-4d39-9a5f-11d526d08ae7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:17 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 Jul 16 13:06:17 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:17 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-254244840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8fae20-166d-410c-8305-c63acb60020b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:14Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume ed8fae20-166d-410c-8305-c63acb60020b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:17 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:17 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b 1073741824 Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6323d83-5127-4661-8cd5-9c6d0b24f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:17 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00bb6f2-392d-47e1-b950-75c3c05f0213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be (c46abbd3-027f-4cb9-9178-e3f0fff6d3be): created successfully Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00bb6f2-392d-47e1-b950-75c3c05f0213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (f9c2e71a-2ba6-4683-a6df-8c251f9bd930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:17 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aee4e9ce-25d2-43b8-b39b-53964b78bbe4 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:17 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:17 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:17 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2" returned: 0 in 0.493s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:17 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2 Jul 16 13:06:17 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:17 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:17 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b 1073741824" returned: 0 in 0.651s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:17 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-dc920a27-8e15-4c95-89cd-356df07a29e2" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:17 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-dc920a27-8e15-4c95-89cd-356df07a29e2" released by "delete_volume" :: held 0.940s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:17 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Created reservations ['f8a856fa-2046-4a13-9766-3b2fea7f2363', '320a13d2-757d-4e21-9259-ef6f4268d8aa', 'e71fc284-dd5a-4b85-9764-0fcf09686dd5', 'e2459719-00c9-4de5-aeba-8bfa93f0cbad'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:18 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:18 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:18 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163658401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd954a8e-6d4f-4456-904b-009f75dcfd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:15Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume cd954a8e-6d4f-4456-904b-009f75dcfd4e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b77190-3247-4a83-bdd0-90759887034c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8fae20-166d-410c-8305-c63acb60020b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee48e94-c5c6-4acd-b2f9-3322e0423cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:18 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e 1073741824 Jul 16 13:06:18 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-ed8fae20-166d-410c-8305-c63acb60020b (ed8fae20-166d-410c-8305-c63acb60020b): created successfully Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee48e94-c5c6-4acd-b2f9-3322e0423cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (8324b08d-8e73-43ce-9e11-e26149730e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-35634c49-3bf8-4af4-b744-b69cf600f383 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:18 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Deleted volume successfully. Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0527797d-52a9-4e7a-a421-1d5fd6334a36 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-dc920a27-8e15-4c95-89cd-356df07a29e2-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:18 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e 1073741824" returned: 0 in 0.524s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:18 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e Jul 16 13:06:18 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.102s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454002330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eec3384-be17-4871-b191-8d120d17ba5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:16Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume 9eec3384-be17-4871-b191-8d120d17ba5a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:19 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ac6cbf-4c6c-4fb1-843b-56f5b0700d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:19 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a 1073741824 Jul 16 13:06:19 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452b8ed-c2ee-4c3c-bbf6-7234aa022e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e (cd954a8e-6d4f-4456-904b-009f75dcfd4e): created successfully Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5452b8ed-c2ee-4c3c-bbf6-7234aa022e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (a49a60a8-d46b-45f7-8ae5-c3a5bd38c97b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-919eb18c-abae-4005-8f3d-2e53ca499c63 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-05a347c9-d3c1-4919-b73d-86f26ccdf64a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-05a347c9-d3c1-4919-b73d-86f26ccdf64a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-quobyte-05a347c9-d3c1-4919-b73d-86f26ccdf64a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-05a347c9-d3c1-4919-b73d-86f26ccdf64a" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa72aaa5-8fb7-4dd1-9b36-2f1943dd9c86]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:19 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a Jul 16 13:06:19 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a 1073741824" returned: 0 in 0.508s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:19 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a Jul 16 13:06:19 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:19 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:19 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a Jul 16 13:06:19 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.750s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1354402354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07527521-905c-46aa-a860-9339755a53a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57625f5722004d8ebfb3fd80b0a3d9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:16Z,use_quota=True,user_id='1b12432f8c64479cbcceedac59333a14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Creating volume 07527521-905c-46aa-a860-9339755a53a1 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:19 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:19 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-05a347c9-d3c1-4919-b73d-86f26ccdf64a" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:19 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 1073741824 Jul 16 13:06:19 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99065390-96c8-4598-bcb0-7de9b5767d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eec3384-be17-4871-b191-8d120d17ba5a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f702b-3c59-42e4-8800-9129f75b9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-05a347c9-d3c1-4919-b73d-86f26ccdf64a" released by "delete_volume" :: held 0.724s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-9eec3384-be17-4871-b191-8d120d17ba5a (9eec3384-be17-4871-b191-8d120d17ba5a): created successfully Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f702b-3c59-42e4-8800-9129f75b9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (309b24b3-8990-4eed-a1cf-7c9c28e82d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3dcbc351-eeb6-461f-ad34-e1ac43a42d4c tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Created reservations ['4c66e635-2c2b-4e4d-8ad2-ffd647b6ea42', '9c9c8ad9-25df-4aa5-af2c-13cb729ed08a', '43be159b-c848-483b-9b82-5cd11befb7c3', '7aad5511-23df-44a2-9c55-a00ccf544e39'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:20 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:20 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-420e4d9f-8cf9-465d-99e1-14b30b156c4f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-420e4d9f-8cf9-465d-99e1-14b30b156c4f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:20 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-quobyte-420e4d9f-8cf9-465d-99e1-14b30b156c4f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Deleted volume successfully. Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-420e4d9f-8cf9-465d-99e1-14b30b156c4f" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-caa81893-da41-4827-859d-6a862b6bce27 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-05a347c9-d3c1-4919-b73d-86f26ccdf64a-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2811c66-3141-4942-b488-a4eb290a688b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:20 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 1073741824" returned: 0 in 0.599s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:20 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 Jul 16 13:06:20 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:20 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f Jul 16 13:06:20 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:20 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df69a059-b856-444d-bb4b-8fd439429260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc37277340bb47219e99ea473f91e67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:15Z,use_quota=True,user_id='ce81546f4fdb4255b529cceb78700ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0eb6541-494a-4395-97a0-1cea66bae67e),volume_type_id=a0eb6541-494a-4395-97a0-1cea66bae67e)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Creating volume df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:20 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0325d144-1815-49c1-bb3b-0c9d5ee18a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07527521-905c-46aa-a860-9339755a53a1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377fe61-f3d6-4341-9ffa-d2ef77c1f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:20 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:20 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1073741824 Jul 16 13:06:20 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Volume volume-07527521-905c-46aa-a860-9339755a53a1 (07527521-905c-46aa-a860-9339755a53a1): created successfully Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377fe61-f3d6-4341-9ffa-d2ef77c1f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:20 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f Jul 16 13:06:20 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Flow 'volume_create_manager' (ae3b1753-4d35-48e7-9e33-a0f7e5115615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a106332e-f7d3-44b9-8556-b664d85cf434 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created volume successfully. Jul 16 13:06:21 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-420e4d9f-8cf9-465d-99e1-14b30b156c4f" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-420e4d9f-8cf9-465d-99e1-14b30b156c4f" released by "delete_volume" :: held 0.709s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Created reservations ['f1691d27-d0dc-4bea-ac0c-227d4a38d1a4', '5c9c8fe9-e921-4994-8192-146fbc3beeb4', '1e0ca016-d09b-4506-bba6-b3982a6d1f95', '51383adf-0d2c-4470-9c70-46093d13d062'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:21 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:21 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:21 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1073741824" returned: 0 in 0.555s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-07527521-905c-46aa-a860-9339755a53a1-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-07527521-905c-46aa-a860-9339755a53a1-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:21 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 Jul 16 13:06:21 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-07527521-905c-46aa-a860-9339755a53a1" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-07527521-905c-46aa-a860-9339755a53a1" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:21 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[db17dbbd-f779-422d-9770-5dcd0eca8017]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Deleted volume successfully. Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef963144-a0e6-4dd1-9c22-acc8a9029659 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-420e4d9f-8cf9-465d-99e1-14b30b156c4f-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-quobyte-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:21 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 Jul 16 13:06:21 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af5664-8741-47d6-bdfb-1f73edd8264f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:21 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Attempting download of 4b00b83b-3331-41a3-b9bb-bb72a37fed19 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}])) to volume df69a059-b856-444d-bb4b-8fd439429260. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[861931db-78f7-4454-95f6-3ddaa7872d63]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:21 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 Jul 16 13:06:21 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3 Jul 16 13:06:22 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1 Jul 16 13:06:22 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" returned: 0 in 0.392s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58 Jul 16 13:06:22 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07527521-905c-46aa-a860-9339755a53a1" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-07527521-905c-46aa-a860-9339755a53a1" released by "delete_volume" :: held 0.807s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:22 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3 Jul 16 13:06:22 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['f47b7cc4-11f2-4650-9992-4ac83b8b7561', '97bccbf1-49ea-4d5f-aa93-64926c004851', '89c8d187-7034-4926-adf2-e87af78cdc52', 'e74ab060-8582-47ea-a915-72475e5f2ac6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58" released by "delete_volume" :: held 0.733s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:22 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Created reservations ['54f3ebeb-c8d0-45f4-b9ca-42de8663cd3c', '7ed39901-681a-4394-9c24-7afa693e1d77', '4b0b2f46-ad77-4074-b733-e7644c7be964', '9b2b6b0a-14bc-4560-9631-8b5bbaaaf7d0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:22 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3" returned: 1 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b00b83b-3331-41a3-b9bb-bb72a37fed19_074n2ys3' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[54825ec3-f8bb-4e63-81c8-83badbe59522]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:22 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:22 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:22 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:23 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "cinder-quobyte-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" acquired by "delete_volume" :: waited 0.046s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c03d09bd-f0c5-4bcd-93e7-f742d0cface3 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-07527521-905c-46aa-a860-9339755a53a1-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa68cc-b301-45f9-a560-a38e04d63bb2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:23 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:23 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae Jul 16 13:06:23 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Deleted volume successfully. Jul 16 13:06:23 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8d430080-17ba-4e9c-9d0a-3e39e9bf35ab tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-99dc8ea7-546e-4ebb-8ad3-a7b8f9bbde58-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:23 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD Jul 16 13:06:23 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:23 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" returned: 0 in 0.449s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:23 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae Jul 16 13:06:23 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:23 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] 4b00b83b-3331-41a3-b9bb-bb72a37fed19 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-9eec3384-be17-4871-b191-8d120d17ba5a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-9eec3384-be17-4871-b191-8d120d17ba5a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:23 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 Jul 16 13:06:23 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-9eec3384-be17-4871-b191-8d120d17ba5a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-9eec3384-be17-4871-b191-8d120d17ba5a" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b9bae-3c7d-4b26-9392-76201072d7d9]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:24 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" returned: 0 in 0.494s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a Jul 16 13:06:24 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-quobyte-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae" released by "delete_volume" :: held 1.012s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Created reservations ['ca1f14fd-cbb7-42e0-ae10-3ca7fc5b4c0d', 'bca9738b-194c-43db-9367-5473bd889a65', '6be05b69-3093-40e7-a0bc-be249a5e5a45', '70443a32-f37e-4766-a299-f728fb53d569'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:24 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:24 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:24 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260" returned: 0 in 0.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b00b83b-3331-41a3-b9bb-bb72a37fed19_pgcaka5ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:06:24 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:24 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1G Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:24 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a Jul 16 13:06:24 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:24 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Deleted volume successfully. Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6e4eab7-fbd5-4266-bb4e-f008e986c886 tempest-CreateVolumesFromImageTest-2114526057 None] Lock "cinder-0c23493a-143c-48b7-bb9e-3f3e8cfa9dae-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:24 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-9eec3384-be17-4871-b191-8d120d17ba5a" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-9eec3384-be17-4871-b191-8d120d17ba5a" released by "delete_volume" :: held 0.797s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:24 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 1G" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Downloaded image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}])) to volume df69a059-b856-444d-bb4b-8fd439429260 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Temporary image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 for user ce81546f4fdb4255b529cceb78700ce8 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Marking volume df69a059-b856-444d-bb4b-8fd439429260 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Copying metadata from image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 to df69a059-b856-444d-bb4b-8fd439429260. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Creating volume glance metadata for volume df69a059-b856-444d-bb4b-8fd439429260 backed by image 4b00b83b-3331-41a3-b9bb-bb72a37fed19 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e215568df263521694a1cd0028d06ebd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['f51e1cf1-14d0-4eb8-997d-ad5627be249b', '0b9b6b03-f4c5-4e7c-8bba-1bbf30a888d8', 'a9b603bd-d029-4924-86ce-f33258590de0', 'b9c1a0eb-8a3a-4832-b27b-670c147125b2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902cad3d-4c5e-4876-a364-9fded58aa614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df69a059-b856-444d-bb4b-8fd439429260', 'volume_size': 1, 'image_id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e215568df263521694a1cd0028d06ebd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dc37277340bb47219e99ea473f91e67e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5931ac601e2dda82309d6f1df0008ac3c8bf1ed2f4d7a31daf1ffab5884eb9322b62115eed5d3a01993e4d0b61488b6fb65faf08528b7375c9e39dd75653a9f', 'id': '4b00b83b-3331-41a3-b9bb-bb72a37fed19', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b00b83b-3331-41a3-b9bb-bb72a37fed19/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:24 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622cedce-4d2a-4276-944a-e2e36dcc08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:24 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Volume volume-df69a059-b856-444d-bb4b-8fd439429260 (df69a059-b856-444d-bb4b-8fd439429260): created successfully Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622cedce-4d2a-4276-944a-e2e36dcc08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Flow 'volume_create_manager' (6cdd1569-4c07-4873-a055-00f9095b3a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f014d1ba-134e-4dc2-bb39-76eb96cf8b0c tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Created volume successfully. Jul 16 13:06:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-cd954a8e-6d4f-4456-904b-009f75dcfd4e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-cd954a8e-6d4f-4456-904b-009f75dcfd4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-cd954a8e-6d4f-4456-904b-009f75dcfd4e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:25 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-cd954a8e-6d4f-4456-904b-009f75dcfd4e" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[289fcec3-1d33-488d-8046-b5e368752c39]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62f24e5a-3d0d-49d8-95e6-2e1f8a4e1248 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-9eec3384-be17-4871-b191-8d120d17ba5a-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:25 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e Jul 16 13:06:25 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:25 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Acquiring lock "cinder-df69a059-b856-444d-bb4b-8fd439429260-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:25 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e Jul 16 13:06:25 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "cinder-df69a059-b856-444d-bb4b-8fd439429260-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Acquiring lock "cinder-quobyte-df69a059-b856-444d-bb4b-8fd439429260" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "cinder-quobyte-df69a059-b856-444d-bb4b-8fd439429260" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb342397-1e65-4403-9e1e-e885eb796d6c]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:25 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-cd954a8e-6d4f-4456-904b-009f75dcfd4e" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-cd954a8e-6d4f-4456-904b-009f75dcfd4e" released by "delete_volume" :: held 0.811s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:25 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 Jul 16 13:06:25 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['416a913d-e5fa-4202-9ec8-46948a7a96ea', '1d887e08-a974-4991-9477-b43e5d36676e', '7778ce2b-0f86-4559-aadd-d821626a49c4', '51d3164a-4c3f-4ac4-93b7-d4af65802acc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:26 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:26 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-ed8fae20-166d-410c-8305-c63acb60020b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-ed8fae20-166d-410c-8305-c63acb60020b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-ed8fae20-166d-410c-8305-c63acb60020b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-ed8fae20-166d-410c-8305-c63acb60020b" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:26 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260" returned: 0 in 0.578s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[201c1cd1-9fdb-4392-a853-d3827973e265]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:26 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260 Jul 16 13:06:26 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:26 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-554c2030-c2cf-4043-8e1d-061a6ac44692 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-cd954a8e-6d4f-4456-904b-009f75dcfd4e-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:26 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b Jul 16 13:06:26 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:26 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-df69a059-b856-444d-bb4b-8fd439429260" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "cinder-quobyte-df69a059-b856-444d-bb4b-8fd439429260" released by "delete_volume" :: held 0.934s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Created reservations ['4571f4a4-c812-444c-99ed-cd609815d56f', 'ae6ec38f-9ea9-4775-8966-a00b5d33bf6b', 'c6aba32a-02ad-473e-8c83-4e9ed8edcf16', '2afa50ed-bc2b-4e65-970a-6c5a3b626f40'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:26 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:26 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b Jul 16 13:06:26 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:26 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:26 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:27 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:27 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ed8fae20-166d-410c-8305-c63acb60020b" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Deleted volume successfully. Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-ed8fae20-166d-410c-8305-c63acb60020b" released by "delete_volume" :: held 0.930s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0da7775d-afc3-46b9-b4b2-d539bf4e5f85 tempest-VolumeAndVolumeTypeFromImageTest-1577655034 None] Lock "cinder-df69a059-b856-444d-bb4b-8fd439429260-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['fb94f76b-5096-4c24-965f-ab20e4e26620', '2b44cf92-1769-4c6e-9a43-852fa0a88390', 'db5a9dff-a5f9-4811-b75e-a05ec6d66fbe', 'aace6531-915e-445e-b959-11af2716396c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:27 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:27 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-c46abbd3-027f-4cb9-9178-e3f0fff6d3be-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-c46abbd3-027f-4cb9-9178-e3f0fff6d3be-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74568fd2-5aa8-4fd4-b325-5218b01e2d86]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:27 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be Jul 16 13:06:27 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:27 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ac93ae9-b801-4ac4-9a23-0b7cdf8d0ba5 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-ed8fae20-166d-410c-8305-c63acb60020b-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:28 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:28 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be Jul 16 13:06:28 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:28 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-c46abbd3-027f-4cb9-9178-e3f0fff6d3be" released by "delete_volume" :: held 0.863s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['934c6e7d-98cc-44c3-9fce-ddc406819dc1', '69dc2c79-646e-4cb8-a66c-9ab3a9a154f7', 'c65f92ac-99b2-46e4-82c9-91255d748f3e', '61b837f7-ff1f-40af-a3f2-a217d972161c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:28 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:28 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-a1d5bb75-959d-419a-8bb4-13e63d580cc7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-a1d5bb75-959d-419a-8bb4-13e63d580cc7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "cinder-quobyte-a1d5bb75-959d-419a-8bb4-13e63d580cc7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-a1d5bb75-959d-419a-8bb4-13e63d580cc7" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[894514ab-8442-4567-9890-c705bf53acb5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:29 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 Jul 16 13:06:29 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:29 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48c248e2-d61b-4f91-814c-f36034448a31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-c46abbd3-027f-4cb9-9178-e3f0fff6d3be-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (427633ab-e14b-49b9-840c-8e9dd4678153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c95394-eecc-4fc5-b52e-18e834c45f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c95394-eecc-4fc5-b52e-18e834c45f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930739821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8600457-25f1-473e-8657-f4a21c862a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:29Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3525b9e-466e-4931-a00e-3430b66e08b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3525b9e-466e-4931-a00e-3430b66e08b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb133b-d43a-44be-98e2-2841744fe94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfb133b-d43a-44be-98e2-2841744fe94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8600457-25f1-473e-8657-f4a21c862a2b', 'volume_name': 'volume-e8600457-25f1-473e-8657-f4a21c862a2b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2bddb0-4c05-4c40-bd20-297f345ff746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2bddb0-4c05-4c40-bd20-297f345ff746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51188f37-9346-4ba1-a0cf-a1bddded2ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume e8600457-25f1-473e-8657-f4a21c862a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8600457-25f1-473e-8657-f4a21c862a2b', 'volume_size': 1} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1930739821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8600457-25f1-473e-8657-f4a21c862a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:29Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:29 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:29 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b 1073741824 Jul 16 13:06:29 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:29 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7" returned: 0 in 0.583s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:29 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7 Jul 16 13:06:29 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:29 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a1d5bb75-959d-419a-8bb4-13e63d580cc7" returned: 0 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-quobyte-a1d5bb75-959d-419a-8bb4-13e63d580cc7" released by "delete_volume" :: held 1.025s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Created reservations ['18f8ddfd-4e43-4594-b1b8-b00af8c6293d', '9aef0b19-b70b-4676-ba3a-c448e3a19159', '50fbea4a-fa37-451f-8697-44e295fa5f01', 'bdd1ddf3-81d6-4687-b0d6-52bfd1dd1ca0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:30 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b 1073741824" returned: 0 in 0.664s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:30 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b Jul 16 13:06:30 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:30 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:30 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:30 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51188f37-9346-4ba1-a0cf-a1bddded2ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8600457-25f1-473e-8657-f4a21c862a2b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac76dab-b085-4e2a-b1b6-34d8e17b6268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-e8600457-25f1-473e-8657-f4a21c862a2b (e8600457-25f1-473e-8657-f4a21c862a2b): created successfully Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac76dab-b085-4e2a-b1b6-34d8e17b6268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:30 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (427633ab-e14b-49b9-840c-8e9dd4678153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f5f8428f-dbdb-4064-9a38-63d8e583fb2a tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Deleted volume successfully. Jul 16 13:06:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3fef7949-73f5-422c-ab11-0290e01a3c31 tempest-CreateVolumesFromSourceVolumeTest-709317123 None] Lock "cinder-a1d5bb75-959d-419a-8bb4-13e63d580cc7-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating offline snapshot 6329d213-af7e-4a41-ad9d-822316099a38 of volume e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:06:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[63caa8b0-a2ad-4e6d-a86d-ec88b91bace1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:31 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b Jul 16 13:06:31 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:32 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:32 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 1G Jul 16 13:06:32 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:32 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 1G" returned: 0 in 0.651s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8600457-25f1-473e-8657-f4a21c862a2b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:32 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8600457-25f1-473e-8657-f4a21c862a2b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 Jul 16 13:06:32 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:33 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8600457-25f1-473e-8657-f4a21c862a2b -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:33 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 is being set with open permissions: ugo+rw Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:33 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 Jul 16 13:06:33 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:33 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:33 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info Jul 16 13:06:33 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:33 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:33 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info is being set with open permissions: ugo+rw Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:33 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info Jul 16 13:06:33 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Flow 'volume_create_manager' (ed7f14d1-7357-42dc-802e-98d2259649ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb42a8f-53b6-47ea-8048-d0b34667e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb42a8f-53b6-47ea-8048-d0b34667e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1608234908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18fa616-1b46-4d68-bc22-c007b14760ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd092e64c434cd1b0d3a570980d8736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:34Z,use_quota=True,user_id='b50b56182a7a4c62822915f820af309f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7576b4cd-2088-48a3-b873-60c12b252c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7576b4cd-2088-48a3-b873-60c12b252c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:34 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975901f8-5a71-4ccf-8199-11bafce09d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975901f8-5a71-4ccf-8199-11bafce09d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18fa616-1b46-4d68-bc22-c007b14760ef', 'volume_name': 'volume-f18fa616-1b46-4d68-bc22-c007b14760ef', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c188a2f0-b214-4b4d-bfcd-ba4e3e1f8e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c188a2f0-b214-4b4d-bfcd-ba4e3e1f8e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9feba3-31bd-490f-9146-cfe1994c0491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Volume f18fa616-1b46-4d68-bc22-c007b14760ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18fa616-1b46-4d68-bc22-c007b14760ef', 'volume_size': 1} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.info" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1608234908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18fa616-1b46-4d68-bc22-c007b14760ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd092e64c434cd1b0d3a570980d8736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:34Z,use_quota=True,user_id='b50b56182a7a4c62822915f820af309f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Creating volume f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:34 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef 1073741824 Jul 16 13:06:34 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-558424de-b147-4e1d-bb90-71751c0c45cb tempest-CreateVolumesFromSnapshotTest-1331756932 None] Create snapshot completed successfully Jul 16 13:06:34 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef 1073741824" returned: 0 in 0.509s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:34 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:34 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:35 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9feba3-31bd-490f-9146-cfe1994c0491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18fa616-1b46-4d68-bc22-c007b14760ef', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1785bf-cbfe-462d-8000-2bae1f1a47ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Volume volume-f18fa616-1b46-4d68-bc22-c007b14760ef (f18fa616-1b46-4d68-bc22-c007b14760ef): created successfully Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1785bf-cbfe-462d-8000-2bae1f1a47ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Flow 'volume_create_manager' (ed7f14d1-7357-42dc-802e-98d2259649ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfba6482-bae5-4892-82fb-294913a78042 tempest-VolumeDependencyTests-2069872255 None] Created volume successfully. Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (eed6b711-2f75-43d6-800d-3be506d3828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23abe2ff-636b-426d-954d-1487d8c76336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23abe2ff-636b-426d-954d-1487d8c76336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615012894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea23f70-bc64-486a-9589-ed1a89bb6528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f24654-c696-4f31-97a3-987730e8ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f24654-c696-4f31-97a3-987730e8ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae2012c-b835-4aa3-b56b-608273749f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae2012c-b835-4aa3-b56b-608273749f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea23f70-bc64-486a-9589-ed1a89bb6528', 'volume_name': 'volume-8ea23f70-bc64-486a-9589-ed1a89bb6528', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf03bb5b-3c73-48d6-91f1-7b6b1a82b835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf03bb5b-3c73-48d6-91f1-7b6b1a82b835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8f5126-eeeb-4a47-9d4b-0498eafcfeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume 8ea23f70-bc64-486a-9589-ed1a89bb6528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea23f70-bc64-486a-9589-ed1a89bb6528', 'volume_size': 1} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615012894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea23f70-bc64-486a-9589-ed1a89bb6528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume 8ea23f70-bc64-486a-9589-ed1a89bb6528 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:35 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:35 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 1073741824 Jul 16 13:06:35 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (2c584d4b-fcbf-4c92-9dab-254eb20a15c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611867fe-84e5-4382-ad8e-da9a5b4e3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611867fe-84e5-4382-ad8e-da9a5b4e3504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061867479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269b108-0b52-4b75-a243-3690f4d59a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a112f22c-de49-4094-88f0-7cb8bdbd3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a112f22c-de49-4094-88f0-7cb8bdbd3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81da503-a877-4b75-aacc-d3b3ac3f5a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81da503-a877-4b75-aacc-d3b3ac3f5a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c269b108-0b52-4b75-a243-3690f4d59a22', 'volume_name': 'volume-c269b108-0b52-4b75-a243-3690f4d59a22', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72b8923-5de1-444b-92a5-bc5f5f427de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72b8923-5de1-444b-92a5-bc5f5f427de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49a2ec2-13ac-44ab-b4aa-876c461a42e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume c269b108-0b52-4b75-a243-3690f4d59a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c269b108-0b52-4b75-a243-3690f4d59a22', 'volume_size': 1} Jul 16 13:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (f9cc23e8-ac94-4fef-b820-0f1ad1402a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add41441-c723-4242-a35c-cea24a1512ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add41441-c723-4242-a35c-cea24a1512ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233609999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f54084-8934-41d0-83aa-d9a1ab1b3777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8013c9ad-8888-4ce1-8f79-ea715579f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8013c9ad-8888-4ce1-8f79-ea715579f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e035df61-0aaa-48e8-b48b-4bfdd6ceba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e035df61-0aaa-48e8-b48b-4bfdd6ceba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f54084-8934-41d0-83aa-d9a1ab1b3777', 'volume_name': 'volume-12f54084-8934-41d0-83aa-d9a1ab1b3777', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a257ffd2-3422-4842-8e6b-1f0fb8ce2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a257ffd2-3422-4842-8e6b-1f0fb8ce2108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c235cf4-2067-413d-8b0d-101305f3a369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume 12f54084-8934-41d0-83aa-d9a1ab1b3777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f54084-8934-41d0-83aa-d9a1ab1b3777', 'volume_size': 1} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 1073741824" returned: 0 in 0.613s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:36 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 Jul 16 13:06:36 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (1750058c-6a7f-446b-bb8f-fb3c8f798f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62e5a3-a945-4524-a1e3-039d64156e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf62e5a3-a945-4524-a1e3-039d64156e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808671841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af67f0d8-c21d-466b-bff6-cba0aa934d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:37Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e40571a-644f-48bd-8f28-492e7cc25e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e40571a-644f-48bd-8f28-492e7cc25e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f6c600-e32b-41f2-b708-7412abb4ac11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f6c600-e32b-41f2-b708-7412abb4ac11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af67f0d8-c21d-466b-bff6-cba0aa934d6e', 'volume_name': 'volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058a86c-927a-4241-9b7a-7f2f1d460193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b058a86c-927a-4241-9b7a-7f2f1d460193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964bb5cf-ab1c-4237-91fa-f2bc7c8c654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume af67f0d8-c21d-466b-bff6-cba0aa934d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e', 'volume_size': 1} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061867479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c269b108-0b52-4b75-a243-3690f4d59a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume c269b108-0b52-4b75-a243-3690f4d59a22 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8f5126-eeeb-4a47-9d4b-0498eafcfeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea23f70-bc64-486a-9589-ed1a89bb6528', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1783a042-b7c7-40e5-ae62-8ebc196c81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:36 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 1073741824 Jul 16 13:06:36 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 (8ea23f70-bc64-486a-9589-ed1a89bb6528): created successfully Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1783a042-b7c7-40e5-ae62-8ebc196c81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (eed6b711-2f75-43d6-800d-3be506d3828f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d63981d8-2a6a-4f9f-95b1-11756410dd8f tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (26617327-c1c0-44cc-98d1-1ff12ea8743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f411c92c-40bf-4bcf-b78c-77471f76fa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f411c92c-40bf-4bcf-b78c-77471f76fa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981201844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0b144b-ea34-4682-bd5e-093b412e8fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:37Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8d04b5-d295-40c5-8951-1a0ae44d31f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8d04b5-d295-40c5-8951-1a0ae44d31f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da06ab1-d882-4ec3-a6e5-7b648de73d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da06ab1-d882-4ec3-a6e5-7b648de73d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0b144b-ea34-4682-bd5e-093b412e8fdc', 'volume_name': 'volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d475dcd-5adf-4ace-99a7-eba7a05e4f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d475dcd-5adf-4ace-99a7-eba7a05e4f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ef390f-e497-48ae-923b-ef11cfaa6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume 7d0b144b-ea34-4682-bd5e-093b412e8fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc', 'volume_size': 1} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:37 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 1073741824" returned: 0 in 0.565s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:37 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 Jul 16 13:06:37 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Flow 'volume_create_manager' (083e7ef0-8f09-4380-8dd4-5aade6353f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:37 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0ea2c5-490a-41d8-ae04-6b9d4303ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-233609999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f54084-8934-41d0-83aa-d9a1ab1b3777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:36Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume 12f54084-8934-41d0-83aa-d9a1ab1b3777 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:37 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0ea2c5-490a-41d8-ae04-6b9d4303ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b849d-8d4d-483f-ab63-1d27cd1b5514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188fdd126c3a4cb2a799c4b7d3defea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:38Z,use_quota=True,user_id='e18b09d610584be9a3ac1df7f5c7df28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f205b4bc-5d0f-4002-b254-583565318337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 1073741824 Jul 16 13:06:37 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f205b4bc-5d0f-4002-b254-583565318337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67a5df-4124-4568-b6d0-618b0c52e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49a2ec2-13ac-44ab-b4aa-876c461a42e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c269b108-0b52-4b75-a243-3690f4d59a22', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32915197-bc52-470f-8821-af03a8863a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-c269b108-0b52-4b75-a243-3690f4d59a22 (c269b108-0b52-4b75-a243-3690f4d59a22): created successfully Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32915197-bc52-470f-8821-af03a8863a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (2c584d4b-fcbf-4c92-9dab-254eb20a15c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-48611d73-b439-4818-b757-ec9bfb3298f8 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67a5df-4124-4568-b6d0-618b0c52e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '225b849d-8d4d-483f-ab63-1d27cd1b5514', 'volume_name': 'volume-225b849d-8d4d-483f-ab63-1d27cd1b5514', 'volume_size': 1, 'image_id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a585a3be4ba765756a6a105a3a2977', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '188fdd126c3a4cb2a799c4b7d3defea4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e3af26aae3e7424371f66a375e6f643cdf4b0924c676220cd8dbabddd8d34116b63d978642460f90702a41d680db6c72cde085db9ec9f810d41e928ad08019', 'id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/355ecf15-6514-4c92-b051-1c0d234e536e/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dad626-8d34-48dd-9988-6b8bec8b2a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dad626-8d34-48dd-9988-6b8bec8b2a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507db8d6-ab36-45e1-a5ff-112a18c5ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Volume 225b849d-8d4d-483f-ab63-1d27cd1b5514: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-225b849d-8d4d-483f-ab63-1d27cd1b5514', 'volume_size': 1, 'image_id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a585a3be4ba765756a6a105a3a2977', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '188fdd126c3a4cb2a799c4b7d3defea4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e3af26aae3e7424371f66a375e6f643cdf4b0924c676220cd8dbabddd8d34116b63d978642460f90702a41d680db6c72cde085db9ec9f810d41e928ad08019', 'id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/355ecf15-6514-4c92-b051-1c0d234e536e/file', 'properties': {}}, 'image_service': } Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Trying to clone 225b849d-8d4d-483f-ab63-1d27cd1b5514 from image 355ecf15-6514-4c92-b051-1c0d234e536e at location (None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 16 13:06:38 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 1073741824" returned: 0 in 0.507s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:38 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 Jul 16 13:06:38 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Image download 0.00 MB at 0.00 MB/s Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[650abf73-b358-41db-a84b-4fcfd41c47c8]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:38 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:38 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:38 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-808671841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af67f0d8-c21d-466b-bff6-cba0aa934d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:37Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume af67f0d8-c21d-466b-bff6-cba0aa934d6e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:38 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e 1073741824 Jul 16 13:06:38 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c235cf4-2067-413d-8b0d-101305f3a369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f54084-8934-41d0-83aa-d9a1ab1b3777', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7714cb0-5a44-40e6-a6d0-9a5feace7a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 (12f54084-8934-41d0-83aa-d9a1ab1b3777): created successfully Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7714cb0-5a44-40e6-a6d0-9a5feace7a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (f9cc23e8-ac94-4fef-b820-0f1ad1402a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-01a2e942-96c5-45a5-bdc6-17a293bd6178 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:38 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:39 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:39 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:39 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Temporary image 355ecf15-6514-4c92-b051-1c0d234e536e is fetched for user e18b09d610584be9a3ac1df7f5c7df28. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 16 13:06:39 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e 1073741824" returned: 0 in 0.621s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[71753b13-cfbb-46d3-a17f-6dfa089c1a9f]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:39 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e Jul 16 13:06:39 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:39 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:39 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:39 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.799s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964bb5cf-ab1c-4237-91fa-f2bc7c8c654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c7d6e6-6e34-45b7-8d3c-4e0794c2349d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Creating offline snapshot c580915b-19d1-44f1-97e9-3c308e339a97 of volume f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:06:39 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e (af67f0d8-c21d-466b-bff6-cba0aa934d6e): created successfully Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c7d6e6-6e34-45b7-8d3c-4e0794c2349d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (1750058c-6a7f-446b-bb8f-fb3c8f798f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71dd90-ef27-4b21-b508-e4282983eb7d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-54cbfab9-f02f-4d32-bfb1-b03087418982 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:39 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:39 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:39 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:39 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:40 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:40 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.392s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:40 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 1G Jul 16 13:06:40 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:40 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 1G" returned: 0 in 0.436s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18fa616-1b46-4d68-bc22-c007b14760ef -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:40 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18fa616-1b46-4d68-bc22-c007b14760ef -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:40 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:40 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18fa616-1b46-4d68-bc22-c007b14760ef -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:40 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 is being set with open permissions: ugo+rw Jul 16 13:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:41 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:41 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Flow 'volume_create_manager' (20f526e2-1c5e-4de4-a777-cf70332d1117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a19e4b-86f0-4323-81f2-53d98d61780c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:41 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a19e4b-86f0-4323-81f2-53d98d61780c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707302969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2dacd-f5e1-41dc-9909-bff5a7c63e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9994697764d3414baaa68b90bb687393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:41Z,use_quota=True,user_id='4042491fc4bc47078715aba54b24a822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16daa36a-0151-401f-abe0-8add45ee634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16daa36a-0151-401f-abe0-8add45ee634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3bdb68-1a65-45bd-a559-2d25379a2824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3bdb68-1a65-45bd-a559-2d25379a2824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f2dacd-f5e1-41dc-9909-bff5a7c63e77', 'volume_name': 'volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c95fa2-3f27-43c0-8e60-127db6681ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c95fa2-3f27-43c0-8e60-127db6681ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4cd880-e324-4350-add6-24dc78df026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Volume 38f2dacd-f5e1-41dc-9909-bff5a7c63e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77', 'volume_size': 1} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:41 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info Jul 16 13:06:41 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:41 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info is being set with open permissions: ugo+rw Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:41 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info Jul 16 13:06:41 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:41 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.info" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.669s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981201844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0b144b-ea34-4682-bd5e-093b412e8fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf4122af104afe8c6d1c73c8029b9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:37Z,use_quota=True,user_id='0b2f7196896b440889bae9fa3acc7705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Creating volume 7d0b144b-ea34-4682-bd5e-093b412e8fdc {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:41 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc 1073741824 Jul 16 13:06:41 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-79a5dc4c-9608-4d20-9840-34c4c6d091aa tempest-VolumeDependencyTests-2069872255 None] Create snapshot completed successfully Jul 16 13:06:42 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc 1073741824" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:42 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc Jul 16 13:06:42 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:42 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225b849d-8d4d-483f-ab63-1d27cd1b5514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188fdd126c3a4cb2a799c4b7d3defea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:38Z,use_quota=True,user_id='e18b09d610584be9a3ac1df7f5c7df28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Creating volume 225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:42 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1073741824 Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ef390f-e497-48ae-923b-ef11cfaa6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:42 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df402924-aa35-4855-9fb9-ad65bd2590e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Volume volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc (7d0b144b-ea34-4682-bd5e-093b412e8fdc): created successfully Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df402924-aa35-4855-9fb9-ad65bd2590e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Flow 'volume_create_manager' (26617327-c1c0-44cc-98d1-1ff12ea8743d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-da41e202-ee04-4dcd-83dc-34d176087dc6 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created volume successfully. Jul 16 13:06:43 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1073741824" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:43 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 Jul 16 13:06:43 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:43 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707302969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2dacd-f5e1-41dc-9909-bff5a7c63e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9994697764d3414baaa68b90bb687393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:41Z,use_quota=True,user_id='4042491fc4bc47078715aba54b24a822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Creating volume 38f2dacd-f5e1-41dc-9909-bff5a7c63e77 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:43 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 1073741824 Jul 16 13:06:43 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Attempting download of 355ecf15-6514-4c92-b051-1c0d234e536e ((None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}])) to volume 225b849d-8d4d-483f-ab63-1d27cd1b5514. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e6df6e-ab90-4216-bf23-6bddb7081016]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Flow 'volume_create_manager' (0f01891a-dfb3-450b-8b1c-8e20a9e2a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdffcd8-62e2-488a-9393-2b662b7347cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-7d0b144b-ea34-4682-bd5e-093b412e8fdc-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdffcd8-62e2-488a-9393-2b662b7347cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-562426191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a14add-fbe2-4467-97d6-1859c7781af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd092e64c434cd1b0d3a570980d8736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c580915b-19d1-44f1-97e9-3c308e339a97,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:43Z,use_quota=True,user_id='b50b56182a7a4c62822915f820af309f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d46161-201c-41a8-94cd-c0d625ead310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d46161-201c-41a8-94cd-c0d625ead310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0299b385-f48f-46b8-a013-32a506c2c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0299b385-f48f-46b8-a013-32a506c2c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7a14add-fbe2-4467-97d6-1859c7781af5', 'volume_name': 'volume-e7a14add-fbe2-4467-97d6-1859c7781af5', 'volume_size': 1, 'snapshot_id': 'c580915b-19d1-44f1-97e9-3c308e339a97'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f05fc66-5830-48b3-8417-1fec2e277ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f05fc66-5830-48b3-8417-1fec2e277ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe173660-4d67-4630-9eeb-f9123eec04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Volume e7a14add-fbe2-4467-97d6-1859c7781af5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7a14add-fbe2-4467-97d6-1859c7781af5', 'volume_size': 1, 'snapshot_id': 'c580915b-19d1-44f1-97e9-3c308e339a97'} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-7d0b144b-ea34-4682-bd5e-093b412e8fdc-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:43 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb Jul 16 13:06:43 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-7d0b144b-ea34-4682-bd5e-093b412e8fdc" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-7d0b144b-ea34-4682-bd5e-093b412e8fdc" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f42d9a-5e09-4f3a-b85e-a306960a3dd4]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:43 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc Jul 16 13:06:43 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:43 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 1073741824" returned: 0 in 0.602s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:43 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 Jul 16 13:06:44 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb Jul 16 13:06:44 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc" returned: 0 in 0.495s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.611s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97-e7a14add-fbe2-4467-97d6-1859c7781af5" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:44 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc Jul 16 13:06:44 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb" returned: 1 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_355ecf15-6514-4c92-b051-1c0d234e536e_escwaazb' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb4cd880-e324-4350-add6-24dc78df026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb089831-321f-43cc-983c-44a517386058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97-e7a14add-fbe2-4467-97d6-1859c7781af5" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Creating volume e7a14add-fbe2-4467-97d6-1859c7781af5 from snapshot c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6247b3d0-f668-4538-b520-f97d9f6af633]: (4, 'raw') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Volume volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 (38f2dacd-f5e1-41dc-9909-bff5a7c63e77): created successfully Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb089831-321f-43cc-983c-44a517386058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Flow 'volume_create_manager' (20f526e2-1c5e-4de4-a777-cf70332d1117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] snapshot: c580915b-19d1-44f1-97e9-3c308e339a97, volume: e7a14add-fbe2-4467-97d6-1859c7781af5, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 13:06:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de443845-0c41-4559-9356-b1a941281d62 tempest-ProjectReaderTests-1073229443 None] Created volume successfully. Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2123f-aae6-4cdb-a041-65d3ada7d1ca]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:44 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7d0b144b-ea34-4682-bd5e-093b412e8fdc" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-7d0b144b-ea34-4682-bd5e-093b412e8fdc" released by "delete_volume" :: held 0.885s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:44 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:44 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['1fb83d9d-5a6a-4310-9152-c5c3b6d4b5aa', '03ff5da6-2f0c-4fc3-9e53-c7167c8614ac', 'ce285886-bd70-4f34-91b5-e33485c6d03f', 'eda304c2-148c-4b6f-a986-a07c1a6720ab'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:44 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:44 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD Jul 16 13:06:44 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:44 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18fa616-1b46-4d68-bc22-c007b14760ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6be1fb-c648-45e7-a046-1509b9be8d95]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:45 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c5e11db0-976e-4354-b394-8f97b913017d tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-7d0b144b-ea34-4682-bd5e-093b412e8fdc-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:45 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:45 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:45 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] 355ecf15-6514-4c92-b051-1c0d234e536e was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:45 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 Jul 16 13:06:45 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:45 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:45 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 Jul 16 13:06:45 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "cinder-38f2dacd-f5e1-41dc-9909-bff5a7c63e77-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-38f2dacd-f5e1-41dc-9909-bff5a7c63e77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "cinder-quobyte-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-quobyte-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" acquired by "delete_volume" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:45 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514" returned: 0 in 0.599s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_355ecf15-6514-4c92-b051-1c0d234e536e_fi16vjf0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:06:45 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Converted 0.00 MB image at 0.00 MB/s Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc96c8a-344b-4641-adc0-f774afc024ea]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:45 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1G Jul 16 13:06:45 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-af67f0d8-c21d-466b-bff6-cba0aa934d6e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-af67f0d8-c21d-466b-bff6-cba0aa934d6e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:46 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 Jul 16 13:06:46 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-af67f0d8-c21d-466b-bff6-cba0aa934d6e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-af67f0d8-c21d-466b-bff6-cba0aa934d6e" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e27d0f2-1d5f-42a1-a83b-1fea9147f87e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:46 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e Jul 16 13:06:46 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:46 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 1G" returned: 0 in 0.845s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Downloaded image 355ecf15-6514-4c92-b051-1c0d234e536e ((None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}])) to volume 225b849d-8d4d-483f-ab63-1d27cd1b5514 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Temporary image 355ecf15-6514-4c92-b051-1c0d234e536e for user e18b09d610584be9a3ac1df7f5c7df28 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Marking volume 225b849d-8d4d-483f-ab63-1d27cd1b5514 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Copying metadata from image 355ecf15-6514-4c92-b051-1c0d234e536e to 225b849d-8d4d-483f-ab63-1d27cd1b5514. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Creating volume glance metadata for volume 225b849d-8d4d-483f-ab63-1d27cd1b5514 backed by image 355ecf15-6514-4c92-b051-1c0d234e536e with: {'image_id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b8a585a3be4ba765756a6a105a3a2977', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507db8d6-ab36-45e1-a5ff-112a18c5ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225b849d-8d4d-483f-ab63-1d27cd1b5514', 'volume_size': 1, 'image_id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/355ecf15-6514-4c92-b051-1c0d234e536e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8a585a3be4ba765756a6a105a3a2977', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '188fdd126c3a4cb2a799c4b7d3defea4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89e3af26aae3e7424371f66a375e6f643cdf4b0924c676220cd8dbabddd8d34116b63d978642460f90702a41d680db6c72cde085db9ec9f810d41e928ad08019', 'id': '355ecf15-6514-4c92-b051-1c0d234e536e', 'created_at': datetime.datetime(2026, 7, 16, 11, 6, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 16, 11, 6, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/355ecf15-6514-4c92-b051-1c0d234e536e/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a4779-88f8-4676-9cbb-4fbab3419fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Volume volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 (225b849d-8d4d-483f-ab63-1d27cd1b5514): created successfully Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835a4779-88f8-4676-9cbb-4fbab3419fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Flow 'volume_create_manager' (083e7ef0-8f09-4380-8dd4-5aade6353f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:47 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e768ec61-43fe-4729-97e5-9f5a1c460a18 tempest-VolumeImageDependencyTests-101783761 None] Created volume successfully. Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" returned: 0 in 1.176s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:47 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e" returned: 0 in 0.884s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:47 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77 Jul 16 13:06:47 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:47 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e Jul 16 13:06:47 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:47 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" returned: 0 in 0.499s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-quobyte-38f2dacd-f5e1-41dc-9909-bff5a7c63e77" released by "delete_volume" :: held 1.777s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Created reservations ['8ca5ad90-0607-400b-a82d-4622633d86ee', '19c58246-14d8-4345-9ae6-57bffedcf21e', '05ebf16a-1915-4560-a0e3-ffbab0aa2d14', '9659038d-7554-4f8f-bacb-32695172b80d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:47 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:47 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:47 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-af67f0d8-c21d-466b-bff6-cba0aa934d6e" returned: 0 in 0.865s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-af67f0d8-c21d-466b-bff6-cba0aa934d6e" released by "delete_volume" :: held 1.870s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['a899d7c7-371b-49a9-8b91-e55c67402c50', '35cdeafa-ef07-45ca-8f98-470c06a394f7', 'f0a9b7a0-437b-4ed5-9b5b-a7fba3fe62ae', 'e4cc1d66-e5c3-4d4f-871b-bd444682daf1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Acquiring lock "cinder-225b849d-8d4d-483f-ab63-1d27cd1b5514-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "cinder-225b849d-8d4d-483f-ab63-1d27cd1b5514-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Acquiring lock "cinder-quobyte-225b849d-8d4d-483f-ab63-1d27cd1b5514" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "cinder-quobyte-225b849d-8d4d-483f-ab63-1d27cd1b5514" acquired by "delete_volume" :: waited 0.129s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:48 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:48 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a1ad5-b0df-4ac8-b455-1ca2110610a1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:48 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.787s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Deleted volume successfully. Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2cb6ff9a-2532-48c3-8f1a-7083a4340419 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-38f2dacd-f5e1-41dc-9909-bff5a7c63e77-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-12f54084-8934-41d0-83aa-d9a1ab1b3777-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-12f54084-8934-41d0-83aa-d9a1ab1b3777-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-12f54084-8934-41d0-83aa-d9a1ab1b3777" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-12f54084-8934-41d0-83aa-d9a1ab1b3777" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:48 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 Jul 16 13:06:48 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb6d28e-111f-4cad-afdb-5fceb3b6718b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:49 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.850s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d8613486-f227-4aab-ae03-77f6bb954ae7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-af67f0d8-c21d-466b-bff6-cba0aa934d6e-delete_volume" released by "delete_volume" :: held 3.312s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:49 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514" returned: 0 in 0.896s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:49 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 Jul 16 13:06:49 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:49 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514 Jul 16 13:06:49 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:49 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777" returned: 0 in 0.927s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:49 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777 Jul 16 13:06:49 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:50 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-225b849d-8d4d-483f-ab63-1d27cd1b5514" returned: 0 in 0.576s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "cinder-quobyte-225b849d-8d4d-483f-ab63-1d27cd1b5514" released by "delete_volume" :: held 1.630s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Flow 'volume_create_manager' (a3750725-bbde-40b6-a8da-bf6113f5493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcb9958-a244-40b1-8d77-3cdddc810dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bcb9958-a244-40b1-8d77-3cdddc810dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930483822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b357020-9f7b-446d-a738-5b94afde134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9994697764d3414baaa68b90bb687393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:50Z,use_quota=True,user_id='4042491fc4bc47078715aba54b24a822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26011b85-65d2-4693-8129-2f6b403aa6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26011b85-65d2-4693-8129-2f6b403aa6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5332c7a-3676-4546-b5f0-719f564512f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5332c7a-3676-4546-b5f0-719f564512f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b357020-9f7b-446d-a738-5b94afde134b', 'volume_name': 'volume-8b357020-9f7b-446d-a738-5b94afde134b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d82533-9740-4a1d-974d-88b032823bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d82533-9740-4a1d-974d-88b032823bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb763cd-aa69-4003-ac6d-3bda53884f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Volume 8b357020-9f7b-446d-a738-5b94afde134b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b357020-9f7b-446d-a738-5b94afde134b', 'volume_size': 1} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Created reservations ['3d11a394-33d4-492e-9c0b-206f0a2e26eb', 'd78e000a-7b35-411a-8fb3-c7c5331bd3cf', 'c53c9880-7c6a-4947-93f4-c01e89537b6f', 'e4887c10-04f5-46b8-9425-96333ab50be6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:50 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:50 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:50 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-12f54084-8934-41d0-83aa-d9a1ab1b3777" returned: 0 in 0.665s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-12f54084-8934-41d0-83aa-d9a1ab1b3777" released by "delete_volume" :: held 1.741s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['e520ea71-12e7-48ac-92ee-4ab2e5ed9135', '6c46efa8-7635-44f1-b9e8-26b48a7f79c7', '88004ba9-05ea-4a8f-a50b-54c216179186', 'c9a2c24a-aa2e-4dbe-bd05-0923ac4aaf58'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:51 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-c269b108-0b52-4b75-a243-3690f4d59a22-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:51 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:51 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.903s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Deleted volume successfully. Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-c269b108-0b52-4b75-a243-3690f4d59a22-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9565fc2c-35c8-4512-8d99-6257df33728f tempest-VolumeImageDependencyTests-101783761 None] Lock "cinder-225b849d-8d4d-483f-ab63-1d27cd1b5514-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-c269b108-0b52-4b75-a243-3690f4d59a22" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-c269b108-0b52-4b75-a243-3690f4d59a22" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb68a7-a295-434e-887d-d54e11ca8f18]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:51 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5" returned: 0 in 6.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a9b8f-f982-4893-9d41-96f97d0d4257]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:51 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.527s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8d70139-29d8-445f-b014-36675cfb9fe1 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-12f54084-8934-41d0-83aa-d9a1ab1b3777-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:51 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 Jul 16 13:06:51 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:51 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:51 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:52 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:52 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22 Jul 16 13:06:52 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:52 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.634s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:06:52 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Converted 1024.00 MB image at 162.50 MB/s Jul 16 13:06:52 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 is being set with open permissions: ugo+rw Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:52 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c269b108-0b52-4b75-a243-3690f4d59a22" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:52 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 Jul 16 13:06:52 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-c269b108-0b52-4b75-a243-3690f4d59a22" released by "delete_volume" :: held 0.813s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['cbf6b003-2959-4ad6-952b-0dcde682fb10', 'f31b4a9a-662b-453d-8ccc-1571d086887f', '33a703bf-f5b1-486c-8fe0-b76babdb5175', '585276bd-2a7e-479f-8860-354d6b6638bf'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:52 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:52 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:52 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" released by "_copy_volume_from_snapshot" :: held 8.224s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97-e7a14add-fbe2-4467-97d6-1859c7781af5" released by "_create_volume_from_snapshot" :: held 8.320s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.359s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930483822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b357020-9f7b-446d-a738-5b94afde134b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9994697764d3414baaa68b90bb687393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:06:50Z,use_quota=True,user_id='4042491fc4bc47078715aba54b24a822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Creating volume 8b357020-9f7b-446d-a738-5b94afde134b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:06:52 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:52 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b 1073741824 Jul 16 13:06:52 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe173660-4d67-4630-9eeb-f9123eec04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a14add-fbe2-4467-97d6-1859c7781af5', 'volume_size': 1, 'snapshot_id': 'c580915b-19d1-44f1-97e9-3c308e339a97'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4da454-5ed1-46ac-a565-05b1b21b4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Volume volume-e7a14add-fbe2-4467-97d6-1859c7781af5 (e7a14add-fbe2-4467-97d6-1859c7781af5): created successfully Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4da454-5ed1-46ac-a565-05b1b21b4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Flow 'volume_create_manager' (0f01891a-dfb3-450b-8b1c-8e20a9e2a193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-680cdd34-9641-4ae4-a1ff-a1b2b5fdad89 tempest-VolumeDependencyTests-2069872255 None] Created volume successfully. Jul 16 13:06:52 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5639f8d3-2c69-42f1-93eb-b6ffc07daec7 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-c269b108-0b52-4b75-a243-3690f4d59a22-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-c580915b-19d1-44f1-97e9-3c308e339a97-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-c580915b-19d1-44f1-97e9-3c308e339a97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Deleting offline snapshot c580915b-19d1-44f1-97e9-3c308e339a97 of volume f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] snapshot_file for this snap is: volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db71f4f-399b-480e-819a-f6379ed63c90]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:53 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b 1073741824" returned: 0 in 0.578s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:53 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b Jul 16 13:06:53 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:53 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:53 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-8ea23f70-bc64-486a-9589-ed1a89bb6528-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-8ea23f70-bc64-486a-9589-ed1a89bb6528-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-8ea23f70-bc64-486a-9589-ed1a89bb6528" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:53 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-8ea23f70-bc64-486a-9589-ed1a89bb6528" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb763cd-aa69-4003-ac6d-3bda53884f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b357020-9f7b-446d-a738-5b94afde134b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0707f8-9b9f-4c0f-a2c1-99d37eafb43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e3c44-ffb9-46ab-a960-00c60517ce85]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:53 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:53 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Volume volume-8b357020-9f7b-446d-a738-5b94afde134b (8b357020-9f7b-446d-a738-5b94afde134b): created successfully Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0707f8-9b9f-4c0f-a2c1-99d37eafb43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Flow 'volume_create_manager' (a3750725-bbde-40b6-a8da-bf6113f5493e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.500s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18fa616-1b46-4d68-bc22-c007b14760ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:06:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4457747a-c529-4973-bea3-8d69a375a646 tempest-ProjectReaderTests-1073229443 None] Created volume successfully. Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5736843-967f-4956-9085-7c1099686537]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:53 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 Jul 16 13:06:53 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:53 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:53 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528" returned: 0 in 0.436s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528 Jul 16 13:06:54 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "cinder-8b357020-9f7b-446d-a738-5b94afde134b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:54 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-8b357020-9f7b-446d-a738-5b94afde134b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:54 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:54 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "cinder-quobyte-8b357020-9f7b-446d-a738-5b94afde134b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-quobyte-8b357020-9f7b-446d-a738-5b94afde134b" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[87868a10-cad3-45c3-9bdd-061cd8fc7f98]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8ea23f70-bc64-486a-9589-ed1a89bb6528" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-8ea23f70-bc64-486a-9589-ed1a89bb6528" released by "delete_volume" :: held 0.808s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:54 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b Jul 16 13:06:54 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['a44d4ec7-ec1e-4a45-a9be-fdd1604a3558', '51de3100-bcc7-46ca-87fa-e99c011e081a', 'c64db887-db8d-440b-a1ae-753327d3899c', '613311b8-c4c0-46e0-9df8-dc24a1f11d61'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:54 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.450s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97 Jul 16 13:06:54 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-6329d213-af7e-4a41-ad9d-822316099a38-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-6329d213-af7e-4a41-ad9d-822316099a38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:54 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b Jul 16 13:06:54 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-6329d213-af7e-4a41-ad9d-822316099a38" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-6329d213-af7e-4a41-ad9d-822316099a38" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleting offline snapshot 6329d213-af7e-4a41-ad9d-822316099a38 of volume e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] snapshot_file for this snap is: volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa1482-f6d0-473b-9d5b-4231e72a3e3d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:54 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7b24c5cc-e975-48d5-a606-1bb4e3d13534 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-8ea23f70-bc64-486a-9589-ed1a89bb6528-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef.c580915b-19d1-44f1-97e9-3c308e339a97" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 Jul 16 13:06:55 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-c580915b-19d1-44f1-97e9-3c308e339a97" released by "_delete_snapshot" :: held 1.929s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" released by "delete_snapshot" :: held 1.954s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-8b357020-9f7b-446d-a738-5b94afde134b" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-quobyte-8b357020-9f7b-446d-a738-5b94afde134b" released by "delete_volume" :: held 0.859s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Created reservations ['02af78e9-c3b7-4846-a3dc-6230c560b13f', 'bcfa72e0-4bd1-430e-b4d1-a1c697ea734c', 'a51fa979-687a-40c3-9890-f6a2dcd4c06d', 'e8de6131-4e68-42c0-ba57-ab7cd75bc9a2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Created reservations ['c111d386-1df6-4388-b1fa-90678eb7f8c0', '33c0bedb-9f37-4abc-9809-4de418be4b91', '7e6a6122-3bf3-43f3-ab48-d398158afbec', 'a26b0a2d-6fd8-4595-a1d0-5ca181a372c0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:55 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:55 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Delete snapshot completed successfully. Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0e43e366-6afa-40c7-8aee-ef15b701286a tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-c580915b-19d1-44f1-97e9-3c308e339a97-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38" returned: 0 in 0.503s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8600457-25f1-473e-8657-f4a21c862a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97b7035d-8a26-46df-acb9-2154d5424bf0 tempest-ProjectAdminTests-571805579 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1372861-a03c-4964-9315-faa9198734bd]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:55 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Deleted volume successfully. Jul 16 13:06:55 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b Jul 16 13:06:55 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-68250045-ad3a-4b89-81c3-b5f73d9325f1 tempest-ProjectReaderTests-1073229443 None] Lock "cinder-8b357020-9f7b-446d-a738-5b94afde134b-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:55 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b" returned: 0 in 0.446s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:56 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 Jul 16 13:06:56 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:56 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:56 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38 Jul 16 13:06:56 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-f18fa616-1b46-4d68-bc22-c007b14760ef-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-f18fa616-1b46-4d68-bc22-c007b14760ef-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3afb8bc-dcfa-49fb-9a64-dac46116283b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:56 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b.6329d213-af7e-4a41-ad9d-822316099a38" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:56 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:56 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-6329d213-af7e-4a41-ad9d-822316099a38" released by "_delete_snapshot" :: held 1.883s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" released by "delete_snapshot" :: held 1.918s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['12116739-0132-45ff-91a1-7169c9779801', 'c2b811e6-e36e-4b34-b8fb-7bde4ef6fc48', 'a7d28641-4c04-47e0-a1ca-7b5d9385912b', 'b9347c86-4ce8-4c01-8f02-65ae03a27bdb'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Delete snapshot completed successfully. Jul 16 13:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6922a880-82a9-4fea-b380-639abb0e3d42 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-6329d213-af7e-4a41-ad9d-822316099a38-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:57 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.535s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:57 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef Jul 16 13:06:57 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:57 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-f18fa616-1b46-4d68-bc22-c007b14760ef" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-f18fa616-1b46-4d68-bc22-c007b14760ef" released by "delete_volume" :: held 0.957s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Created reservations ['6ed40d97-9129-4935-ba0d-567f53daf80a', 'b4db3814-3123-4779-b3a2-d274439a7082', '69e03650-21c6-4012-93d9-e32928d6e9fe', 'ea2563df-5d66-4e08-a70e-8a4b266b87b1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:57 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:57 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:57 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Deleted volume successfully. Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dabc3552-5f7e-4ed6-97f5-5b924bcbd77e tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-f18fa616-1b46-4d68-bc22-c007b14760ef-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-e8600457-25f1-473e-8657-f4a21c862a2b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-e8600457-25f1-473e-8657-f4a21c862a2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a193f072-e4ff-4211-802f-29137525071a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:58 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b Jul 16 13:06:58 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:58 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:58 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b Jul 16 13:06:58 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-e7a14add-fbe2-4467-97d6-1859c7781af5-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-e7a14add-fbe2-4467-97d6-1859c7781af5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:58 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e8600457-25f1-473e-8657-f4a21c862a2b" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-quobyte-e8600457-25f1-473e-8657-f4a21c862a2b" released by "delete_volume" :: held 0.718s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d9d09b-15a0-43ad-923e-f2f3c9e3ac49]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Created reservations ['0e1947f6-ee22-480f-9d43-94392b0cd8e9', '5b341ff9-486a-4502-90af-db8097fa30ed', '8f51918b-642f-4834-a668-a12b70a62653', '1f06cc59-9cb7-4f89-89dd-d4d49da5ba9c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:59 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 Jul 16 13:06:59 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:59 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:59 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:59 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:06:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Deleted volume successfully. Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0edf7603-05e5-4213-b814-f3e2181fc549 tempest-CreateVolumesFromSnapshotTest-1331756932 None] Lock "cinder-e8600457-25f1-473e-8657-f4a21c862a2b-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:59 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5" returned: 0 in 0.434s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:59 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5 Jul 16 13:06:59 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:06:59 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-e7a14add-fbe2-4467-97d6-1859c7781af5" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-quobyte-e7a14add-fbe2-4467-97d6-1859c7781af5" released by "delete_volume" :: held 0.758s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Created reservations ['6a9d2b77-e72a-4d5c-be83-8144c3031b25', '10f74142-47b9-4140-866d-46c5fdfed37b', 'e70fb7c7-0e2d-4b12-8477-822d30ac3067', 'cfe680ef-f29d-4a1a-a3fb-c8abbb53bd6c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:06:59 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:06:59 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:00 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Deleted volume successfully. Jul 16 13:07:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4467f5a7-b8a7-4957-924d-7a8926c3e5f9 tempest-VolumeDependencyTests-2069872255 None] Lock "cinder-e7a14add-fbe2-4467-97d6-1859c7781af5-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=268,cinder:SELECT=188,cinder:INSERT=66,cinder:DELETE=25 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=196,cinder:UPDATE=272,cinder:DELETE=23,cinder:INSERT=77 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Flow 'volume_create_manager' (b3a2e13b-caf6-414b-8a5b-47e172fe7511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6859b32f-ec3b-4077-89b3-3ea8926c6399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6859b32f-ec3b-4077-89b3-3ea8926c6399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637084c7-f199-4fed-9640-3f6fff6797a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f334e28d7d844b891a11aa7b0b8c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:03Z,use_quota=True,user_id='0308b954679842c38d6259c1adeeb474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a090c54-7b93-4cd4-a853-d0f44dbc6a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a090c54-7b93-4cd4-a853-d0f44dbc6a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b068d76-1ef7-4be2-9c72-d82f16059b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b068d76-1ef7-4be2-9c72-d82f16059b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637084c7-f199-4fed-9640-3f6fff6797a4', 'volume_name': 'volume-637084c7-f199-4fed-9640-3f6fff6797a4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f018c-5f42-4475-8c8c-71593440d4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0f018c-5f42-4475-8c8c-71593440d4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72108b0b-e880-4bf5-af39-6f998445905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Volume 637084c7-f199-4fed-9640-3f6fff6797a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637084c7-f199-4fed-9640-3f6fff6797a4', 'volume_size': 1} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637084c7-f199-4fed-9640-3f6fff6797a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f334e28d7d844b891a11aa7b0b8c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:03Z,use_quota=True,user_id='0308b954679842c38d6259c1adeeb474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Creating volume 637084c7-f199-4fed-9640-3f6fff6797a4 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:02 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:02 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 1073741824 Jul 16 13:07:02 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:03 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 1073741824" returned: 0 in 0.460s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:03 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 Jul 16 13:07:03 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:03 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72108b0b-e880-4bf5-af39-6f998445905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637084c7-f199-4fed-9640-3f6fff6797a4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65700a2-66fe-4a39-a056-f0bb0b92bf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Volume volume-637084c7-f199-4fed-9640-3f6fff6797a4 (637084c7-f199-4fed-9640-3f6fff6797a4): created successfully Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65700a2-66fe-4a39-a056-f0bb0b92bf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Flow 'volume_create_manager' (b3a2e13b-caf6-414b-8a5b-47e172fe7511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f94effda-b00f-4d01-a5be-56c02c97774e tempest-CinderUnicodeTest-1935465038 None] Created volume successfully. Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (02d95bfd-e7fd-4dc2-a598-1288c872dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a150ef25-e909-460c-b1fa-ee4dabc82219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a150ef25-e909-460c-b1fa-ee4dabc82219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127164990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb1ede-70b2-4f5c-bd88-538d19f97a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:05Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931f77d8-3fd7-4ab4-a266-63401880269d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931f77d8-3fd7-4ab4-a266-63401880269d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e47bad-3844-41e2-be96-bb52ebf823f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e47bad-3844-41e2-be96-bb52ebf823f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06fb1ede-70b2-4f5c-bd88-538d19f97a3c', 'volume_name': 'volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ffd61-6ad3-4724-928e-7ec3f53edb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9ffd61-6ad3-4724-928e-7ec3f53edb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcde768-9f39-4684-a4da-fb0e2a9ff0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Volume 06fb1ede-70b2-4f5c-bd88-538d19f97a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c', 'volume_size': 1} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127164990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06fb1ede-70b2-4f5c-bd88-538d19f97a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:05Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Creating volume 06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:04 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:04 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c 1073741824 Jul 16 13:07:04 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:05 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c 1073741824" returned: 0 in 0.520s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:05 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c Jul 16 13:07:05 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Flow 'volume_create_manager' (271b9fb1-8bc3-4ac2-82c4-b056281de594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b3bb0-ea57-473f-84f2-09cf8d24c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b3bb0-ea57-473f-84f2-09cf8d24c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197700926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7b221-9539-458e-8e13-19b36d4055fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f334e28d7d844b891a11aa7b0b8c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:05Z,use_quota=True,user_id='0308b954679842c38d6259c1adeeb474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b6e876-7170-4272-b999-6f2f81fc0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b6e876-7170-4272-b999-6f2f81fc0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece5e13-9920-4faa-843a-d39214ee03da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fece5e13-9920-4faa-843a-d39214ee03da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c7b221-9539-458e-8e13-19b36d4055fc', 'volume_name': 'volume-c3c7b221-9539-458e-8e13-19b36d4055fc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9588ce3-51b0-4baa-92d7-f82ee8130541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9588ce3-51b0-4baa-92d7-f82ee8130541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daffd72-31a3-4f1c-8fb6-9c2d3426ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Volume c3c7b221-9539-458e-8e13-19b36d4055fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c7b221-9539-458e-8e13-19b36d4055fc', 'volume_size': 1} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:05 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-197700926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c7b221-9539-458e-8e13-19b36d4055fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f334e28d7d844b891a11aa7b0b8c54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:05Z,use_quota=True,user_id='0308b954679842c38d6259c1adeeb474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Creating volume c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcde768-9f39-4684-a4da-fb0e2a9ff0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc 1073741824 Jul 16 13:07:05 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a6ba2-1b36-44f6-8e22-cf75164609a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Volume volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c (06fb1ede-70b2-4f5c-bd88-538d19f97a3c): created successfully Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14a6ba2-1b36-44f6-8e22-cf75164609a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (02d95bfd-e7fd-4dc2-a598-1288c872dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-63da08db-4084-4dc6-905d-35f30fbad030 tempest-ProjectReaderTests-986599878 None] Created volume successfully. Jul 16 13:07:06 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc 1073741824" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:06 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc Jul 16 13:07:06 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:06 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7daffd72-31a3-4f1c-8fb6-9c2d3426ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c7b221-9539-458e-8e13-19b36d4055fc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904945d3-7df9-4340-a371-a8d43c5c5f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Volume volume-c3c7b221-9539-458e-8e13-19b36d4055fc (c3c7b221-9539-458e-8e13-19b36d4055fc): created successfully Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904945d3-7df9-4340-a371-a8d43c5c5f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Flow 'volume_create_manager' (271b9fb1-8bc3-4ac2-82c4-b056281de594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d61d33b0-b052-494a-af38-1284639adaa4 tempest-CinderUnicodeTest-1935465038 None] Created volume successfully. Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Creating offline snapshot a317798e-22a4-4343-905d-f9785d0eac88 of volume 06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d6e0c7-d740-40c4-971d-1686697b4bd6]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:07 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c Jul 16 13:07:07 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:07 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:07 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 1G Jul 16 13:07:07 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:07 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 1G" returned: 0 in 0.493s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:07 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 Jul 16 13:07:07 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:08 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 is being set with open permissions: ugo+rw Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:08 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 Jul 16 13:07:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:08 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:08 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info Jul 16 13:07:08 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:08 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:08 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:08 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info is being set with open permissions: ugo+rw Jul 16 13:07:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:08 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info Jul 16 13:07:08 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:09 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 29 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:07:09 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.info" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.349s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Creating offline snapshot 68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 of volume c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7233a199-c709-4ff4-9c50-eba0bd22991a tempest-ProjectReaderTests-986599878 None] Create snapshot completed successfully Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a975dbe-81ef-4d29-88e4-6a9d625c643f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:09 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc Jul 16 13:07:09 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:09 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:09 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 1G Jul 16 13:07:09 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:10 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 1G" returned: 0 in 0.440s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7b221-9539-458e-8e13-19b36d4055fc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:10 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7b221-9539-458e-8e13-19b36d4055fc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 Jul 16 13:07:10 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:10 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c7b221-9539-458e-8e13-19b36d4055fc -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:10 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 is being set with open permissions: ugo+rw Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:10 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 Jul 16 13:07:10 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-a317798e-22a4-4343-905d-f9785d0eac88-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-a317798e-22a4-4343-905d-f9785d0eac88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-a317798e-22a4-4343-905d-f9785d0eac88" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-a317798e-22a4-4343-905d-f9785d0eac88" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Deleting offline snapshot a317798e-22a4-4343-905d-f9785d0eac88 of volume 06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] snapshot_file for this snap is: volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b430966-3ad5-447b-8f99-998958a28c10]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:10 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:10 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 Jul 16 13:07:10 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:10 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info Jul 16 13:07:10 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:10 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88" returned: 0 in 0.422s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a79707d-5c82-45cc-b648-8ac087ce5ddc]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:11 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info is being set with open permissions: ugo+rw Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:11 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info Jul 16 13:07:11 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:11 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c Jul 16 13:07:11 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:11 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.info" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef981f1f-3029-43f8-a239-cb45f326ec90 tempest-CinderUnicodeTest-1935465038 None] Create snapshot completed successfully Jul 16 13:07:11 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:11 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 Jul 16 13:07:11 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:11 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:11 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88 Jul 16 13:07:11 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:12 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c.a317798e-22a4-4343-905d-f9785d0eac88" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-a317798e-22a4-4343-905d-f9785d0eac88" released by "_delete_snapshot" :: held 1.572s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" released by "delete_snapshot" :: held 1.616s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-quobyte-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Deleting offline snapshot 68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 of volume c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] snapshot_file for this snap is: volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8e4019-bfdc-49f5-b179-4b1db34e7a72]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Created reservations ['6a11c48b-7ea5-4bd5-9079-d369645c9dae', '5c46c0ff-4381-416a-9e28-79ffe9a171b8', 'db2a1838-3825-476a-b320-4e63df6333a6', '510e4ccf-5f28-4617-adc0-035e1f686601'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Delete snapshot completed successfully. Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f3ec8322-7008-4f2d-981d-9c3b044d05d9 tempest-ProjectReaderTests-986599878 None] Lock "cinder-a317798e-22a4-4343-905d-f9785d0eac88-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:12 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 Jul 16 13:07:12 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:12 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c7b221-9539-458e-8e13-19b36d4055fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[982fd929-254d-4aad-92db-3608c7e5388d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-06fb1ede-70b2-4f5c-bd88-538d19f97a3c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "cinder-06fb1ede-70b2-4f5c-bd88-538d19f97a3c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:12 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc Jul 16 13:07:12 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[55726e5a-e031-4969-8acd-c82910953e97]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:12 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c Jul 16 13:07:12 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:13 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:13 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 Jul 16 13:07:13 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:13 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" returned: 0 in 0.424s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:13 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c Jul 16 13:07:13 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:13 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:13 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1 Jul 16 13:07:13 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:13 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-06fb1ede-70b2-4f5c-bd88-538d19f97a3c" released by "delete_volume" :: held 0.791s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Created reservations ['759bf14d-9685-499c-bb10-c81e35f741d1', 'f03a85af-59fa-4b6f-961f-927a2a58f734', 'f171f770-b967-4c37-a937-05ce575fc30d', 'd94ba7b3-0950-4618-af7a-1e0790fba425'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:13 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc.68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:13 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1" released by "_delete_snapshot" :: held 1.656s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" released by "delete_snapshot" :: held 1.682s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Created reservations ['ad3684ae-25df-47cf-a773-8193ef51b30a', '08f10ebe-c59d-4e81-97b3-e70d11f971dc', '4c7f6f6a-b72e-4706-a4b5-a27c4de8acde', '75b07987-8064-42eb-9788-82b499c5da70'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Delete snapshot completed successfully. Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bb827ca4-b8aa-45ab-9049-bf56f862af4f tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-68c268a0-3ba1-4ef8-b2ea-ba34cadf15a1-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:13 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Deleted volume successfully. Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee4e1075-526e-403b-9dcb-20f1adc0fae3 tempest-ProjectReaderTests-986599878 None] Lock "cinder-06fb1ede-70b2-4f5c-bd88-538d19f97a3c-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-c3c7b221-9539-458e-8e13-19b36d4055fc-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-c3c7b221-9539-458e-8e13-19b36d4055fc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133cbc5-a06d-46ff-960c-e278ddbe9944]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (f4529b58-abeb-4b56-885e-dced65b0b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3da07-55d6-48d0-9976-801422f4a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91b3da07-55d6-48d0-9976-801422f4a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79792387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfe8b03-dfec-4c36-acc2-578c97f8f2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:14Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a84c86-a1c7-4bc8-ae37-db999379d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a84c86-a1c7-4bc8-ae37-db999379d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e70aa42-4ff5-4266-8a3b-01b0a952be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e70aa42-4ff5-4266-8a3b-01b0a952be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfe8b03-dfec-4c36-acc2-578c97f8f2f1', 'volume_name': 'volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a420d8-47a7-4de7-87ea-64fada1a089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a420d8-47a7-4de7-87ea-64fada1a089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbe56d9-da69-4ce4-8e58-7be41cac29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Volume ebfe8b03-dfec-4c36-acc2-578c97f8f2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1', 'volume_size': 1} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79792387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfe8b03-dfec-4c36-acc2-578c97f8f2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:14Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Creating volume ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:14 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:14 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc Jul 16 13:07:14 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:14 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 1073741824 Jul 16 13:07:14 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:14 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:14 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc Jul 16 13:07:14 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:14 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 1073741824" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:15 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 Jul 16 13:07:15 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:15 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c3c7b221-9539-458e-8e13-19b36d4055fc" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-c3c7b221-9539-458e-8e13-19b36d4055fc" released by "delete_volume" :: held 0.763s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Created reservations ['307d3db3-cb28-4fe2-a1b8-ae4386d4cc96', '4693fd1e-f4e7-49f3-b7b2-f6d851ca6506', '44de3235-cbf0-49df-9077-d553e9f4b284', '04580d42-da81-4942-823f-b2036c5dd83f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:15 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:15 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:15 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbe56d9-da69-4ce4-8e58-7be41cac29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0f6862-9ec5-4852-8d38-14fa3e32a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Volume volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 (ebfe8b03-dfec-4c36-acc2-578c97f8f2f1): created successfully Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0f6862-9ec5-4852-8d38-14fa3e32a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (f4529b58-abeb-4b56-885e-dced65b0b998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-10118811-af91-4ffd-be6f-ddc1b3751e86 tempest-ProjectReaderTests-986599878 None] Created volume successfully. Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-637084c7-f199-4fed-9640-3f6fff6797a4-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-637084c7-f199-4fed-9640-3f6fff6797a4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "cinder-quobyte-637084c7-f199-4fed-9640-3f6fff6797a4" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:15 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-637084c7-f199-4fed-9640-3f6fff6797a4" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Deleted volume successfully. Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[75122a91-7c8f-4138-9c91-f9d80d602aba]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14a20c8f-05c8-4aff-9d64-d380f90a8cc4 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-c3c7b221-9539-458e-8e13-19b36d4055fc-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:15 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 Jul 16 13:07:15 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:15 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:15 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4 Jul 16 13:07:15 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:16 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-637084c7-f199-4fed-9640-3f6fff6797a4" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-quobyte-637084c7-f199-4fed-9640-3f6fff6797a4" released by "delete_volume" :: held 0.688s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Created reservations ['1de26197-4761-4cb9-afd0-5fb23f3d1215', '7f7e3ce8-377e-4bba-b4a4-ea0bda530df0', 'c62fe16f-a603-4a76-8ed8-5d618adf8e92', '880e2871-acf3-46f2-a851-11f41eb0e560'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:16 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:16 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:16 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Deleted volume successfully. Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fd1be363-540c-4f4d-b14e-74e8f8480487 tempest-CinderUnicodeTest-1935465038 None] Lock "cinder-637084c7-f199-4fed-9640-3f6fff6797a4-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Creating offline snapshot d42c0142-240e-45c2-9dd0-8eaa48c297b1 of volume ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e19a25-cf65-44dd-8a4e-c88e22c1a960]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:16 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 Jul 16 13:07:16 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:17 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:17 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 1G Jul 16 13:07:17 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:17 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 1G" returned: 0 in 0.498s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:17 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 Jul 16 13:07:17 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:18 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:18 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 is being set with open permissions: ugo+rw Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:18 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 Jul 16 13:07:18 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:18 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:18 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info Jul 16 13:07:18 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:18 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:18 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info is being set with open permissions: ugo+rw Jul 16 13:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:18 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info Jul 16 13:07:18 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:19 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.info" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d8abbfbb-5cf3-4f49-b46d-d7440d71970a tempest-ProjectReaderTests-986599878 None] Create snapshot completed successfully Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-d42c0142-240e-45c2-9dd0-8eaa48c297b1-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-d42c0142-240e-45c2-9dd0-8eaa48c297b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-d42c0142-240e-45c2-9dd0-8eaa48c297b1" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-d42c0142-240e-45c2-9dd0-8eaa48c297b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Deleting offline snapshot d42c0142-240e-45c2-9dd0-8eaa48c297b1 of volume ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] snapshot_file for this snap is: volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fa0236-46be-491f-b3b6-20bf40ce84ce]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:20 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 Jul 16 13:07:20 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:20 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebe9b6-30a0-47ef-a7ab-0467f9ed0e02]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:20 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 Jul 16 13:07:20 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (e2df02f0-e972-4a71-9ab8-e65229bf3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f2737c-e2ad-44ac-af7b-9f2a60e5fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f2737c-e2ad-44ac-af7b-9f2a60e5fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356185995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b89a61-4d0f-4904-b79b-b509f7a19a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:21Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47a5a70-fbaf-4a21-9d10-13779a4bfc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47a5a70-fbaf-4a21-9d10-13779a4bfc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30462956-9e83-4bc8-b66f-d6c044bad357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30462956-9e83-4bc8-b66f-d6c044bad357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b89a61-4d0f-4904-b79b-b509f7a19a35', 'volume_name': 'volume-25b89a61-4d0f-4904-b79b-b509f7a19a35', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c3bff7-2b1b-457c-b455-0dd3990f3bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c3bff7-2b1b-457c-b455-0dd3990f3bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901708b-3b1e-4e8d-8243-54d3aabe84d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Volume 25b89a61-4d0f-4904-b79b-b509f7a19a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b89a61-4d0f-4904-b79b-b509f7a19a35', 'volume_size': 1} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356185995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b89a61-4d0f-4904-b79b-b509f7a19a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:21Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Creating volume 25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:20 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:20 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 1073741824 Jul 16 13:07:20 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:20 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:21 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 Jul 16 13:07:21 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:21 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:21 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 1073741824" returned: 0 in 0.529s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:21 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1 Jul 16 13:07:21 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:21 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 Jul 16 13:07:21 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:21 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1.d42c0142-240e-45c2-9dd0-8eaa48c297b1" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-d42c0142-240e-45c2-9dd0-8eaa48c297b1" released by "_delete_snapshot" :: held 1.635s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" released by "delete_snapshot" :: held 1.668s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:21 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9901708b-3b1e-4e8d-8243-54d3aabe84d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b89a61-4d0f-4904-b79b-b509f7a19a35', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6001f6-822d-4182-bc20-f3bb7672acd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Volume volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 (25b89a61-4d0f-4904-b79b-b509f7a19a35): created successfully Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6001f6-822d-4182-bc20-f3bb7672acd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (e2df02f0-e972-4a71-9ab8-e65229bf3a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-528124ed-7eae-4f99-a30a-139831ef66c4 tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Created reservations ['e0751fd5-5cf1-4839-8426-ff31690b9700', '6dbc5851-8a4c-4b5e-bf03-ac7e8d40aec5', '82f52cec-5710-4761-8c16-23efa912a543', '59895310-3002-42db-a6d7-2749f1ecc9cd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Delete snapshot completed successfully. Jul 16 13:07:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-347eda5d-6d0a-49e5-865a-e15ce8a4cf11 tempest-ProjectReaderTests-986599878 None] Lock "cinder-d42c0142-240e-45c2-9dd0-8eaa48c297b1-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "cinder-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9589e055-331e-4b94-aef6-38708f073743]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:22 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 Jul 16 13:07:22 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:22 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:22 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1 Jul 16 13:07:22 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:23 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1" released by "delete_volume" :: held 0.902s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Created reservations ['4648e5be-d675-4c6a-ad93-f3e084be4c42', '28326035-d80d-4ef1-96e0-cf10f09ad412', '607a0eb9-e5eb-4fa2-a3b6-619cc3753266', '8b2cf6e6-add8-4705-bef6-8bda090a3337'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot a46660d6-932c-4ca1-ab23-eec8c97324d6 of volume 25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb2d6d0-7f10-47d0-b5ed-ced8165d2f82]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:23 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:23 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:23 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 Jul 16 13:07:23 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:23 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Deleted volume successfully. Jul 16 13:07:23 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f709a00c-b728-4c51-84bc-b7634a179e74 tempest-ProjectReaderTests-986599878 None] Lock "cinder-ebfe8b03-dfec-4c36-acc2-578c97f8f2f1-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:23 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 1G Jul 16 13:07:23 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:24 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 1G" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:24 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 Jul 16 13:07:24 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:24 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 is being set with open permissions: ugo+rw Jul 16 13:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:24 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 Jul 16 13:07:24 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (948bd247-5166-4611-b2d8-d6532cd3e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfce0fc-8117-49ad-96ab-ea7c753c6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bfce0fc-8117-49ad-96ab-ea7c753c6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029908912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876a3834-364e-4387-9408-3c18a237d4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:25Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b72db78-1914-4590-b1ca-27aced617eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b72db78-1914-4590-b1ca-27aced617eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cbbb4d-9f4d-4f29-b293-fe1733b209b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cbbb4d-9f4d-4f29-b293-fe1733b209b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876a3834-364e-4387-9408-3c18a237d4c8', 'volume_name': 'volume-876a3834-364e-4387-9408-3c18a237d4c8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a729cc7-6bfd-493e-9cdb-ad47795a63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a729cc7-6bfd-493e-9cdb-ad47795a63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce85bc8-9bef-4d5c-9e85-c378d94ac084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Volume 876a3834-364e-4387-9408-3c18a237d4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876a3834-364e-4387-9408-3c18a237d4c8', 'volume_size': 1} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:25 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:25 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info Jul 16 13:07:25 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:25 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:25 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info is being set with open permissions: ugo+rw Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:25 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info Jul 16 13:07:25 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:25 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.info" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1029908912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876a3834-364e-4387-9408-3c18a237d4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:25Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Creating volume 876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:25 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 1073741824 Jul 16 13:07:25 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cee09c38-09d6-4970-8af5-5a3dd72416d5 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:07:26 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 1073741824" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:26 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 Jul 16 13:07:26 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-a46660d6-932c-4ca1-ab23-eec8c97324d6-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:26 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-a46660d6-932c-4ca1-ab23-eec8c97324d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-a46660d6-932c-4ca1-ab23-eec8c97324d6" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce85bc8-9bef-4d5c-9e85-c378d94ac084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876a3834-364e-4387-9408-3c18a237d4c8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239eb3c-10fc-4bf9-bd71-37b662ceb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Volume volume-876a3834-364e-4387-9408-3c18a237d4c8 (876a3834-364e-4387-9408-3c18a237d4c8): created successfully Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e239eb3c-10fc-4bf9-bd71-37b662ceb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (948bd247-5166-4611-b2d8-d6532cd3e604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a46660d6-932c-4ca1-ab23-eec8c97324d6" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot a46660d6-932c-4ca1-ab23-eec8c97324d6 of volume 25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-25252b14-e64a-483a-bea0-54584e60140c tempest-ProjectReaderTests-986599878 None] Created volume successfully. Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc4bc10-126a-4223-9829-117d1798cafa]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:26 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 Jul 16 13:07:26 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:27 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6" returned: 0 in 0.427s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b89a61-4d0f-4904-b79b-b509f7a19a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a5c897-4332-42e7-9ce2-3709feada655]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:27 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 Jul 16 13:07:27 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Creating offline snapshot ba8a7860-7439-4497-aab9-5fef9ae4265a of volume 876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a23191-5b4d-4ed2-a8c3-d345ee3af94f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:27 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 Jul 16 13:07:27 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:27 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:27 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 Jul 16 13:07:27 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:27 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:27 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a 1G Jul 16 13:07:27 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:27 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:27 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6 Jul 16 13:07:27 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:28 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35.a46660d6-932c-4ca1-ab23-eec8c97324d6" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:28 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a 1G" returned: 0 in 0.449s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876a3834-364e-4387-9408-3c18a237d4c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a46660d6-932c-4ca1-ab23-eec8c97324d6" released by "_delete_snapshot" :: held 1.681s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" released by "delete_snapshot" :: held 1.745s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:28 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876a3834-364e-4387-9408-3c18a237d4c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a Jul 16 13:07:28 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Created reservations ['5affd579-c530-4a43-937a-cc0c7ec314b0', 'fd8384cc-8942-47b2-aa27-c3eabd6accf2', '1c1d1de6-800b-4df0-9d63-af1d1ba1853d', '8ab7dd45-2a69-4f18-9ec4-1ee239232388'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5e9ac868-cde4-4e78-b683-c83c29b2a8b5 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-a46660d6-932c-4ca1-ab23-eec8c97324d6-delete_snapshot" released by "delete_snapshot" :: held 1.927s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:28 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-876a3834-364e-4387-9408-3c18a237d4c8 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:28 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a is being set with open permissions: ugo+rw Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:28 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a Jul 16 13:07:28 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-25b89a61-4d0f-4904-b79b-b509f7a19a35-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "cinder-25b89a61-4d0f-4904-b79b-b509f7a19a35-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa348a68-a2bb-478c-8bb7-ba38cdd64c10]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:28 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:29 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 Jul 16 13:07:29 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:29 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info Jul 16 13:07:29 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:29 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:29 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info is being set with open permissions: ugo+rw Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:29 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:29 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info Jul 16 13:07:29 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:29 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35 Jul 16 13:07:29 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:29 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.info" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:29 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-25b89a61-4d0f-4904-b79b-b509f7a19a35" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-25b89a61-4d0f-4904-b79b-b509f7a19a35" released by "delete_volume" :: held 0.850s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c9737e0b-f973-4529-aea4-d20d90f091fc tempest-ProjectReaderTests-986599878 None] Create snapshot completed successfully Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Created reservations ['a478f1a5-00e2-4de2-b2c7-577412bab8ae', '933b6f00-015d-44a8-b5d4-d3d4040c25a7', '555521b0-51f1-4be1-8ee6-313a9a1eca38', '430d7fe7-6d40-4d50-8501-8ad2020b84a6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:29 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:29 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:30 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6b9281e8-bf47-49f0-95f2-3b22957008ba tempest-ProjectMemberTests-1354279683 None] Lock "cinder-25b89a61-4d0f-4904-b79b-b509f7a19a35-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (cd23c328-fc0e-45a7-94d7-1bc348bc086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1ba68d-6844-4cc8-816f-7b5b578dfc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1ba68d-6844-4cc8-816f-7b5b578dfc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561422450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6fc64b-e36f-4956-be6c-947ac41cbd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:30Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d3e5de-c17f-4545-b0a3-955e65a0c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d3e5de-c17f-4545-b0a3-955e65a0c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26290ca-1b85-4deb-9cc0-214fe3d0e279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26290ca-1b85-4deb-9cc0-214fe3d0e279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6fc64b-e36f-4956-be6c-947ac41cbd0c', 'volume_name': 'volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda2949-eda1-4d54-b0ab-94d97e60a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cda2949-eda1-4d54-b0ab-94d97e60a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f34d90a-3f1d-49c8-be18-d101ac6b28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Volume 3a6fc64b-e36f-4956-be6c-947ac41cbd0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c', 'volume_size': 1} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561422450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6fc64b-e36f-4956-be6c-947ac41cbd0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:30Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Creating volume 3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:30 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:30 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c 1073741824 Jul 16 13:07:30 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-ba8a7860-7439-4497-aab9-5fef9ae4265a-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-ba8a7860-7439-4497-aab9-5fef9ae4265a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-ba8a7860-7439-4497-aab9-5fef9ae4265a" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ba8a7860-7439-4497-aab9-5fef9ae4265a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Deleting offline snapshot ba8a7860-7439-4497-aab9-5fef9ae4265a of volume 876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] snapshot_file for this snap is: volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1cfbe9-0d92-43ed-b04b-2ce972a5b475]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:30 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a Jul 16 13:07:30 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:30 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c 1073741824" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:31 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c Jul 16 13:07:31 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:31 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-876a3834-364e-4387-9408-3c18a237d4c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e5954-72af-4c79-884b-0092b8d02f67]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:31 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:31 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 Jul 16 13:07:31 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f34d90a-3f1d-49c8-be18-d101ac6b28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ba8fc8-0393-45da-afa4-a0f36bd45271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Volume volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c (3a6fc64b-e36f-4956-be6c-947ac41cbd0c): created successfully Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ba8fc8-0393-45da-afa4-a0f36bd45271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (cd23c328-fc0e-45a7-94d7-1bc348bc086e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fbd9c6c8-8baf-4215-984b-7fcc9f21909a tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:07:31 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:31 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a Jul 16 13:07:31 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:31 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:31 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a Jul 16 13:07:31 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:32 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8.ba8a7860-7439-4497-aab9-5fef9ae4265a" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-ba8a7860-7439-4497-aab9-5fef9ae4265a" released by "_delete_snapshot" :: held 1.533s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" released by "delete_snapshot" :: held 1.563s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Created reservations ['131350aa-d6a0-48f4-88c2-5bb9cca72d50', '8d5fe9e1-7adc-4a6c-b17c-9c2f0a80069c', '996a5c12-3faf-4575-a29b-c7fd1eb52e06', 'aa85b93d-6f6d-4246-b4be-52961579aaa9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Delete snapshot completed successfully. Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7d22498f-624c-4329-a790-620fa7d377e1 tempest-ProjectReaderTests-986599878 None] Lock "cinder-ba8a7860-7439-4497-aab9-5fef9ae4265a-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 of volume 3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfa9098-e5ac-44d0-bf8a-c03871362a06]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:32 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c Jul 16 13:07:32 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-876a3834-364e-4387-9408-3c18a237d4c8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "cinder-876a3834-364e-4387-9408-3c18a237d4c8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[793a4b12-bee1-4684-b404-b6307026e397]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:33 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" returned: 0 in 0.497s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:33 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 1G Jul 16 13:07:33 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:33 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 Jul 16 13:07:33 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:33 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:33 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8 Jul 16 13:07:33 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:33 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 1G" returned: 0 in 0.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:33 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 Jul 16 13:07:33 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:33 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-876a3834-364e-4387-9408-3c18a237d4c8" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-876a3834-364e-4387-9408-3c18a237d4c8" released by "delete_volume" :: held 0.907s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Created reservations ['04a9cc2d-ea87-4793-ae00-49be653b0b2b', '6fa712d6-3ef8-484e-aa14-7ed61d23e0f3', '4835ec78-a405-44c3-9582-46144ab1b877', 'fb65a9fc-1d1b-497a-9de3-771969deeb3f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:34 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 is being set with open permissions: ugo+rw Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:34 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 Jul 16 13:07:34 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:34 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:34 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:34 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:34 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Deleted volume successfully. Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-46ffd3c6-0208-4206-83e4-553037ba108c tempest-ProjectReaderTests-986599878 None] Lock "cinder-876a3834-364e-4387-9408-3c18a237d4c8-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:34 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info Jul 16 13:07:34 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (a3102f19-37a1-4d4b-a994-634bc7b585b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ba5af7-4a45-47f7-bc97-5be504933936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ba5af7-4a45-47f7-bc97-5be504933936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336156378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659a764a-4f14-4c12-b5a4-02795108ada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:35Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9d5c44-7147-411b-aafe-1949b0577d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9d5c44-7147-411b-aafe-1949b0577d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b22c70d-e2ff-49ed-8569-890218855150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b22c70d-e2ff-49ed-8569-890218855150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659a764a-4f14-4c12-b5a4-02795108ada9', 'volume_name': 'volume-659a764a-4f14-4c12-b5a4-02795108ada9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498ff511-d53e-4063-b204-d87af6fb1d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498ff511-d53e-4063-b204-d87af6fb1d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ce4786-00ca-46a5-9130-21241fd31270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Volume 659a764a-4f14-4c12-b5a4-02795108ada9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659a764a-4f14-4c12-b5a4-02795108ada9', 'volume_size': 1} Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:34 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info" returned: 0 in 0.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info is being set with open permissions: ugo+rw Jul 16 13:07:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:34 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info Jul 16 13:07:34 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:35 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.info" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336156378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659a764a-4f14-4c12-b5a4-02795108ada9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:35Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Creating volume 659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:35 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:35 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 1073741824 Jul 16 13:07:35 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dbfb96a9-c953-4a66-b03e-9acdaa67dea3 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:07:35 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 1073741824" returned: 0 in 0.604s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:35 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 Jul 16 13:07:35 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 of volume 3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a8fcd-bfe6-444c-ab6e-b561cdf2f37b]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:36 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ce4786-00ca-46a5-9130-21241fd31270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659a764a-4f14-4c12-b5a4-02795108ada9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ff7b2d-a972-4f7f-858d-0718131e9c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:36 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 Jul 16 13:07:36 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Volume volume-659a764a-4f14-4c12-b5a4-02795108ada9 (659a764a-4f14-4c12-b5a4-02795108ada9): created successfully Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ff7b2d-a972-4f7f-858d-0718131e9c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (a3102f19-37a1-4d4b-a994-634bc7b585b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7843f0f2-55e5-4a31-a4dd-07bf301d16fa tempest-ProjectReaderTests-986599878 None] Created volume successfully. Jul 16 13:07:36 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" returned: 0 in 0.460s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e3d339-00db-4e15-81e4-9d2deefa46ff]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:36 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c Jul 16 13:07:36 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:36 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Creating offline snapshot 1f521574-ce16-4cf1-8976-95b39c872e1a of volume 659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:37 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 Jul 16 13:07:37 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d8497-9561-400e-9fc6-88b3f25bdc21]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:37 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 Jul 16 13:07:37 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:37 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:37 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89 Jul 16 13:07:37 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:37 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9" returned: 0 in 0.540s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:37 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a 1G Jul 16 13:07:37 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:37 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c.b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89" released by "_delete_snapshot" :: held 1.909s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" released by "delete_snapshot" :: held 1.938s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Created reservations ['9b9caec6-381b-49cb-a038-7b5ab6bf5a10', '9b7237dd-9af6-4cdc-ab52-321c2cb06743', 'ba4046ea-4968-4967-a762-0a7d3470399d', '9e95d470-9cfa-4a2b-8d54-037ad59bef93'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:07:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b3a6bc69-5d82-4627-b159-bb2038fa39af tempest-ProjectMemberTests-1354279683 None] Lock "cinder-b3fbbac0-15bb-4827-9e6d-a8bf0aa99e89-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:38 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a 1G" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659a764a-4f14-4c12-b5a4-02795108ada9 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:38 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659a764a-4f14-4c12-b5a4-02795108ada9 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a Jul 16 13:07:38 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-3a6fc64b-e36f-4956-be6c-947ac41cbd0c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-3a6fc64b-e36f-4956-be6c-947ac41cbd0c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cd31c1-e3aa-45a7-982b-17364195ca2a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:38 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c Jul 16 13:07:38 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Flow 'volume_create_manager' (7ece7507-7061-41ca-8fa9-acdb9ea9ac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d15edc0-9d50-4e62-9652-0024bb8a5e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:38 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-659a764a-4f14-4c12-b5a4-02795108ada9 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a is being set with open permissions: ugo+rw Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d15edc0-9d50-4e62-9652-0024bb8a5e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-58925367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4fb11b-f097-4617-a461-87f25823e440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f2d4418ba04162aa2b334e8cb02a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:38Z,use_quota=True,user_id='2aaa09cb971b4e51bc080a9c0b71b65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:38 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a Jul 16 13:07:38 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a32c8bf-2514-4461-ae84-bb81850af7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a32c8bf-2514-4461-ae84-bb81850af7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2fd6d1-3715-474f-afff-0a19090bddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2fd6d1-3715-474f-afff-0a19090bddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4fb11b-f097-4617-a461-87f25823e440', 'volume_name': 'volume-2c4fb11b-f097-4617-a461-87f25823e440', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81b8ec1-7c25-40e6-a3e0-499acdb3fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c81b8ec1-7c25-40e6-a3e0-499acdb3fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1eb0a-2093-4234-a30b-45d87c12c135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Volume 2c4fb11b-f097-4617-a461-87f25823e440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4fb11b-f097-4617-a461-87f25823e440', 'volume_size': 1} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:38 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" returned: 0 in 0.381s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:38 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c Jul 16 13:07:38 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:38 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:38 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info Jul 16 13:07:38 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:38 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-3a6fc64b-e36f-4956-be6c-947ac41cbd0c" released by "delete_volume" :: held 0.706s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Created reservations ['97d838f7-0dd7-4f23-a7a5-4763c89a0726', '5fe91623-2294-4323-9d2d-00519fee561c', '4295e974-6e4d-43d7-90ef-9d6c5966248b', '382f97e0-00fe-4ce8-9af0-d64a346251e5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:38 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info is being set with open permissions: ugo+rw Jul 16 13:07:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:39 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info Jul 16 13:07:39 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:39 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:39 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:39 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.info" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:39 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-58925367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4fb11b-f097-4617-a461-87f25823e440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f2d4418ba04162aa2b334e8cb02a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:38Z,use_quota=True,user_id='2aaa09cb971b4e51bc080a9c0b71b65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Creating volume 2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:39 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 1073741824 Jul 16 13:07:39 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:07:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3f35e6af-22db-4807-8022-37903a9b5638 tempest-ProjectReaderTests-986599878 None] Create snapshot completed successfully Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-13dfa604-5a2b-49e6-a156-0267e5da61bc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-3a6fc64b-e36f-4956-be6c-947ac41cbd0c-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (5412c67c-e811-4101-8e5d-7027db34a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d54657b-d305-4ec9-8b7b-6fc358a99bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d54657b-d305-4ec9-8b7b-6fc358a99bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795514619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c06750-5c7a-4175-ba48-ce0c7bbbc52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:40Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63c655-7f41-4ce0-9f7a-a41dc3a0fba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:39 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa63c655-7f41-4ce0-9f7a-a41dc3a0fba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38759527-1104-4fcf-8860-09ab99479e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38759527-1104-4fcf-8860-09ab99479e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c06750-5c7a-4175-ba48-ce0c7bbbc52f', 'volume_name': 'volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ac7c07-9d1f-4ced-9978-7cd16d43fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ac7c07-9d1f-4ced-9978-7cd16d43fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a2fc5-6095-4d78-98e5-e3005706c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Volume 63c06750-5c7a-4175-ba48-ce0c7bbbc52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f', 'volume_size': 1} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 1073741824" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:39 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:39 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:40 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.286s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795514619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c06750-5c7a-4175-ba48-ce0c7bbbc52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:40Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Creating volume 63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:40 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-1f521574-ce16-4cf1-8976-95b39c872e1a-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1eb0a-2093-4234-a30b-45d87c12c135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4fb11b-f097-4617-a461-87f25823e440', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:40 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f 1073741824 Jul 16 13:07:40 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ff3735-b5db-4b4c-a2f9-a34f192f4c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-1f521574-ce16-4cf1-8976-95b39c872e1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Volume volume-2c4fb11b-f097-4617-a461-87f25823e440 (2c4fb11b-f097-4617-a461-87f25823e440): created successfully Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ff3735-b5db-4b4c-a2f9-a34f192f4c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Flow 'volume_create_manager' (7ece7507-7061-41ca-8fa9-acdb9ea9ac6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-1f521574-ce16-4cf1-8976-95b39c872e1a" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8084cb2e-a1f4-448e-a9d0-eb18b8e45117 tempest-SnapshotDependencyTests-67715678 None] Created volume successfully. Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-1f521574-ce16-4cf1-8976-95b39c872e1a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Deleting offline snapshot 1f521574-ce16-4cf1-8976-95b39c872e1a of volume 659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] snapshot_file for this snap is: volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[013414da-826a-4107-9c4d-cc83abacd731]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:40 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a Jul 16 13:07:40 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:40 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f 1073741824" returned: 0 in 0.523s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:40 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a" returned: 0 in 0.465s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-659a764a-4f14-4c12-b5a4-02795108ada9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:40 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f Jul 16 13:07:40 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6d47d1-8514-4ef4-ac32-f37113e4422a]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:40 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 Jul 16 13:07:40 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:40 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.167s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd5a2fc5-6095-4d78-98e5-e3005706c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5157a222-8858-4fa9-aa5b-fab7830e73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Creating offline snapshot b89614af-834f-46d7-944b-8edbbbbc164a of volume 2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Volume volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f (63c06750-5c7a-4175-ba48-ce0c7bbbc52f): created successfully Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5157a222-8858-4fa9-aa5b-fab7830e73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (5412c67c-e811-4101-8e5d-7027db34a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9591e4c-5209-4812-b213-e85c391f5d0e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-446dd231-eafc-4f40-9cba-205ea81c036b tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:07:41 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:41 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:41 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:41 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a Jul 16 13:07:41 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:41 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:41 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a 1G Jul 16 13:07:41 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:41 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:41 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a Jul 16 13:07:41 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:41 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9.1f521574-ce16-4cf1-8976-95b39c872e1a" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-1f521574-ce16-4cf1-8976-95b39c872e1a" released by "_delete_snapshot" :: held 1.565s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" released by "delete_snapshot" :: held 1.598s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:41 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a 1G" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4fb11b-f097-4617-a461-87f25823e440 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:41 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4fb11b-f097-4617-a461-87f25823e440 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:41 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Created reservations ['24e15818-9d2d-4f83-ab35-3add8020b1f4', '81720da2-3245-4c2f-a187-cc41ca0e3f1f', '4ac6c4a0-ba54-4a71-9270-bf8b917d8e67', '39acaa31-8bc8-4a79-bf37-34e95af57f82'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Delete snapshot completed successfully. Jul 16 13:07:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec41397-ea3c-49d5-93f8-50cf3639bc73 tempest-ProjectReaderTests-986599878 None] Lock "cinder-1f521574-ce16-4cf1-8976-95b39c872e1a-delete_snapshot" released by "delete_snapshot" :: held 1.818s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:42 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4fb11b-f097-4617-a461-87f25823e440 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a is being set with open permissions: ugo+rw Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:42 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:42 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-659a764a-4f14-4c12-b5a4-02795108ada9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "cinder-659a764a-4f14-4c12-b5a4-02795108ada9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dcead7-1348-45f9-87a2-47c18e9428cb]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:42 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:42 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info Jul 16 13:07:42 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:42 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 Jul 16 13:07:42 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:42 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info is being set with open permissions: ugo+rw Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:42 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info Jul 16 13:07:42 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:42 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:42 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9 Jul 16 13:07:42 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:42 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.info" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.989s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 6e2ca6e5-d683-435c-8985-a1cc1e865ffd of volume 63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-290ddbe3-d707-49dd-9424-fb62724a635f tempest-SnapshotDependencyTests-67715678 None] Create snapshot completed successfully Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d1b0d1-7b1a-490e-b283-27d2c60c55b8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:43 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-659a764a-4f14-4c12-b5a4-02795108ada9" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-659a764a-4f14-4c12-b5a4-02795108ada9" released by "delete_volume" :: held 0.732s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Created reservations ['efb5013c-2b89-44ac-9305-15eba370c61b', '016a263e-b429-4c0d-b1c3-2530760ec1e6', '6dfbe68e-68c4-452d-a340-20007a95b59c', '555107d3-4758-415c-aad5-5ba4fb6461a0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:43 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f Jul 16 13:07:43 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:43 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:43 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:43 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:43 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd 1G Jul 16 13:07:43 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:43 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Deleted volume successfully. Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-42e22f5c-3785-437f-8c87-6f1c5f7547f2 tempest-ProjectReaderTests-986599878 None] Lock "cinder-659a764a-4f14-4c12-b5a4-02795108ada9-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:43 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd 1G" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:43 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd Jul 16 13:07:43 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (bdcdf9d5-554e-4003-9b4c-c470876a9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe36035-380c-4a4f-aeb0-f020f8bba468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe36035-380c-4a4f-aeb0-f020f8bba468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883811863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07af156d-c028-41ac-b5ca-c3b676dc38fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:44Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f4897-f248-4850-b372-612a4bbcbb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209f4897-f248-4850-b372-612a4bbcbb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6466165-8ea8-4499-b46c-93e31e1b0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6466165-8ea8-4499-b46c-93e31e1b0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07af156d-c028-41ac-b5ca-c3b676dc38fd', 'volume_name': 'volume-07af156d-c028-41ac-b5ca-c3b676dc38fd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b555c4a-1d22-42ed-b55b-f19c56e82d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b555c4a-1d22-42ed-b55b-f19c56e82d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c349bc3-918f-4a22-aaf0-dd9a6feb7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Volume 07af156d-c028-41ac-b5ca-c3b676dc38fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07af156d-c028-41ac-b5ca-c3b676dc38fd', 'volume_size': 1} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:44 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:44 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd is being set with open permissions: ugo+rw Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:44 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd Jul 16 13:07:44 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:44 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:44 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info Jul 16 13:07:44 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Flow 'volume_create_manager' (2417db54-f43c-4214-8758-a08e208a0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543e226f-090b-402f-9e60-1e05ee7b29d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (543e226f-090b-402f-9e60-1e05ee7b29d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c0009f-cb6b-4577-b5d3-79ebb6e64398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7f2d4418ba04162aa2b334e8cb02a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b89614af-834f-46d7-944b-8edbbbbc164a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:44Z,use_quota=True,user_id='2aaa09cb971b4e51bc080a9c0b71b65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b12b79-3ade-4b05-991e-c950f25aaf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b12b79-3ade-4b05-991e-c950f25aaf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce29ccc5-19e2-49b2-b81c-b92ce5e69a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce29ccc5-19e2-49b2-b81c-b92ce5e69a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9c0009f-cb6b-4577-b5d3-79ebb6e64398', 'volume_name': 'volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398', 'volume_size': 1, 'snapshot_id': 'b89614af-834f-46d7-944b-8edbbbbc164a'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd103e12-8e82-42f4-bb6d-69affc909943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd103e12-8e82-42f4-bb6d-69affc909943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adae9938-e0e7-472b-a1e6-66ee024353ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Volume d9c0009f-cb6b-4577-b5d3-79ebb6e64398: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398', 'volume_size': 1, 'snapshot_id': 'b89614af-834f-46d7-944b-8edbbbbc164a'} Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:44 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:44 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info is being set with open permissions: ugo+rw Jul 16 13:07:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:44 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info Jul 16 13:07:44 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:45 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.info" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883811863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07af156d-c028-41ac-b5ca-c3b676dc38fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd4c5ed75c241eebbaa98f0505e8364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:44Z,use_quota=True,user_id='c442e1271b9e4c41bd9add0ef1ecd4e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Creating volume 07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:45 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:45 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd 1073741824 Jul 16 13:07:45 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6ac5e94c-ee65-4e1c-a414-847a886b0668 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:07:45 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd 1073741824" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:45 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd Jul 16 13:07:45 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:45 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.078s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c349bc3-918f-4a22-aaf0-dd9a6feb7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07af156d-c028-41ac-b5ca-c3b676dc38fd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20db8da2-ec4a-4237-a64b-af6fe7f3d5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Creating volume d9c0009f-cb6b-4577-b5d3-79ebb6e64398 from snapshot b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:45 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Volume volume-07af156d-c028-41ac-b5ca-c3b676dc38fd (07af156d-c028-41ac-b5ca-c3b676dc38fd): created successfully Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20db8da2-ec4a-4237-a64b-af6fe7f3d5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Flow 'volume_create_manager' (bdcdf9d5-554e-4003-9b4c-c470876a9710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] snapshot: b89614af-834f-46d7-944b-8edbbbbc164a, volume: d9c0009f-cb6b-4577-b5d3-79ebb6e64398, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 16 13:07:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-71f164b7-d4d2-4f43-9561-bd61515a5485 tempest-ProjectReaderTests-986599878 None] Created volume successfully. Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda7e80-4e37-47ef-b548-25da287551d3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:45 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:45 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:46 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c4fb11b-f097-4617-a461-87f25823e440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-6e2ca6e5-d683-435c-8985-a1cc1e865ffd-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faf7ef3-3ee5-42f5-bf4b-e10902aabb46]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-6e2ca6e5-d683-435c-8985-a1cc1e865ffd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-6e2ca6e5-d683-435c-8985-a1cc1e865ffd" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-6e2ca6e5-d683-435c-8985-a1cc1e865ffd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 6e2ca6e5-d683-435c-8985-a1cc1e865ffd of volume 63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fe36f5-9ecf-429b-aaf1-bbe921755803]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:46 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:46 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:46 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd Jul 16 13:07:46 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:46 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Path /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:46 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 Jul 16 13:07:46 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:46 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccdc633-0877-42bf-b72a-62eae06d9675]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:46 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f Jul 16 13:07:46 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:47 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:47 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd Jul 16 13:07:47 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:47 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd" returned: 0 in 0.808s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:48 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd Jul 16 13:07:48 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:48 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f.6e2ca6e5-d683-435c-8985-a1cc1e865ffd" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-6e2ca6e5-d683-435c-8985-a1cc1e865ffd" released by "_delete_snapshot" :: held 2.132s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" released by "delete_snapshot" :: held 2.174s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Created reservations ['dd865c04-3d8e-4e95-80b9-11c9af3bfcb5', '0e8f00db-268c-41b6-bcbc-b893dfbb8b80', '845b010e-1137-4a5a-be6f-4cb4399cfd76', 'edcc6755-4a5d-4e16-8f40-0a76a1d91b47'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:07:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3c6c2209-aa06-49a7-bf0d-51a356ec85fc tempest-ProjectMemberTests-1354279683 None] Lock "cinder-6e2ca6e5-d683-435c-8985-a1cc1e865ffd-delete_snapshot" released by "delete_snapshot" :: held 2.455s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-63c06750-5c7a-4175-ba48-ce0c7bbbc52f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-63c06750-5c7a-4175-ba48-ce0c7bbbc52f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c926f53-dcc4-4c5c-b724-ab7719552c07]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:50 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f Jul 16 13:07:50 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:50 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" returned: 0 in 0.679s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:50 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f Jul 16 13:07:50 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:51 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" returned: 0 in 0.564s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-63c06750-5c7a-4175-ba48-ce0c7bbbc52f" released by "delete_volume" :: held 1.409s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:51 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" returned: 0 in 4.655s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7556060-2448-44e8-8b6a-f833ffed5427]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Created reservations ['d0774f54-de06-401a-881d-4e3a7bcceeb9', '7aa143c5-046f-43b1-897c-9fcd6938c852', 'c6e7a786-4769-4f91-a5c0-b5f3ca752a7f', '4c0dff09-6d91-481b-8b9c-007869196870'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:51 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:51 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:51 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:51 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:51 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-60654c0b-6b09-4590-a200-9a552e09da7d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-63c06750-5c7a-4175-ba48-ce0c7bbbc52f-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:51 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.543s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Image conversion details: src /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 16 13:07:51 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Converted 1024.00 MB image at 219.89 MB/s Jul 16 13:07:51 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 is being set with open permissions: ugo+rw Jul 16 13:07:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:51 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 Jul 16 13:07:51 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:52 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" released by "_copy_volume_from_snapshot" :: held 6.328s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" released by "_create_volume_from_snapshot" :: held 6.373s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.404s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.995s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Creating offline snapshot 78a36924-2714-4bd4-897b-ba4951bb2ad2 of volume 07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adae9938-e0e7-472b-a1e6-66ee024353ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398', 'volume_size': 1, 'snapshot_id': 'b89614af-834f-46d7-944b-8edbbbbc164a'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45621eaa-e6c1-4b76-bb26-ea7ab23f9aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee1163b-062a-44cf-8877-5a0f8b24fa71]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Volume volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 (d9c0009f-cb6b-4577-b5d3-79ebb6e64398): created successfully Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45621eaa-e6c1-4b76-bb26-ea7ab23f9aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Flow 'volume_create_manager' (2417db54-f43c-4214-8758-a08e208a0e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4f89a0c6-66ea-40e2-9ae2-710bd3e55c15 tempest-SnapshotDependencyTests-67715678 None] Created volume successfully. Jul 16 13:07:52 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd Jul 16 13:07:52 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:07:52 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (72843f4e-2614-4c8d-ac89-4e6e77d106ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb092ee3-0f7a-4c47-bf69-bb284b3e0def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:52 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 1G Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb092ee3-0f7a-4c47-bf69-bb284b3e0def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128184694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ac540-4026-46e9-bacc-f81fa1728d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:53Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f33971-bc97-4c9c-b652-73ac4f28971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f33971-bc97-4c9c-b652-73ac4f28971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd849373-72a7-4eb2-a682-e39e1da5860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd849373-72a7-4eb2-a682-e39e1da5860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846ac540-4026-46e9-bacc-f81fa1728d80', 'volume_name': 'volume-846ac540-4026-46e9-bacc-f81fa1728d80', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea0eb25-073e-497d-a52c-839c54c2de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea0eb25-073e-497d-a52c-839c54c2de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e79805-3031-4481-a061-b7889862e53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Volume 846ac540-4026-46e9-bacc-f81fa1728d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846ac540-4026-46e9-bacc-f81fa1728d80', 'volume_size': 1} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:52 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 1G" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07af156d-c028-41ac-b5ca-c3b676dc38fd -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07af156d-c028-41ac-b5ca-c3b676dc38fd -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 Jul 16 13:07:53 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:53 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07af156d-c028-41ac-b5ca-c3b676dc38fd -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 is being set with open permissions: ugo+rw Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 Jul 16 13:07:53 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-b89614af-834f-46d7-944b-8edbbbbc164a-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-b89614af-834f-46d7-944b-8edbbbbc164a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Deleting offline snapshot b89614af-834f-46d7-944b-8edbbbbc164a of volume 2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] snapshot_file for this snap is: volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[183051b6-0593-403a-baa9-f4d8412335b7]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:53 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:53 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info Jul 16 13:07:53 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:53 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:53 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info is being set with open permissions: ugo+rw Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c4fb11b-f097-4617-a461-87f25823e440(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:53 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info Jul 16 13:07:53 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a333728-c864-4bc5-a824-6064af8c916d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:53 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:53 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.info" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128184694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ac540-4026-46e9-bacc-f81fa1728d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:07:53Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Creating volume 846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:07:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:54 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 1073741824 Jul 16 13:07:54 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7be0d195-bb18-412b-805d-5039f1a382b1 tempest-ProjectReaderTests-986599878 None] Create snapshot completed successfully Jul 16 13:07:54 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:54 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:54 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 1073741824" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:54 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 Jul 16 13:07:54 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:54 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a Jul 16 13:07:54 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-78a36924-2714-4bd4-897b-ba4951bb2ad2-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-78a36924-2714-4bd4-897b-ba4951bb2ad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-78a36924-2714-4bd4-897b-ba4951bb2ad2" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-78a36924-2714-4bd4-897b-ba4951bb2ad2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Deleting offline snapshot 78a36924-2714-4bd4-897b-ba4951bb2ad2 of volume 07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] snapshot_file for this snap is: volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[48938bf9-daff-4816-b62e-8946075452d6]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:54 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e79805-3031-4481-a061-b7889862e53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846ac540-4026-46e9-bacc-f81fa1728d80', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c7288b-27cf-4f50-a1a6-bef7ae728d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:07:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Volume volume-846ac540-4026-46e9-bacc-f81fa1728d80 (846ac540-4026-46e9-bacc-f81fa1728d80): created successfully Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c7288b-27cf-4f50-a1a6-bef7ae728d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (72843f4e-2614-4c8d-ac89-4e6e77d106ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:07:54 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f4cd4a84-0a4e-4562-8ea6-23212828bef1 tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440.b89614af-834f-46d7-944b-8edbbbbc164a" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:54 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 Jul 16 13:07:54 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-b89614af-834f-46d7-944b-8edbbbbc164a" released by "_delete_snapshot" :: held 1.565s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" released by "delete_snapshot" :: held 1.593s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Created reservations ['dcbaca17-1a8f-417c-985e-8edc8b01272c', '4038743c-2677-46df-b5a2-4b09ba1b5534', '88beaf92-f6b4-4232-95e0-767a345b6f9e', '5d473ba2-8332-4f5b-9cf3-60d7cd70a93a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Delete snapshot completed successfully. Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-05f24b13-d5ed-4bdd-bcee-ed17cd56a222 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-b89614af-834f-46d7-944b-8edbbbbc164a-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:55 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07af156d-c028-41ac-b5ca-c3b676dc38fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bc1967-e832-4bfc-92d6-2b395a37d989]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:55 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd Jul 16 13:07:55 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-2c4fb11b-f097-4617-a461-87f25823e440-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-2c4fb11b-f097-4617-a461-87f25823e440-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:55 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f27039b-209d-409e-a44a-2bfef1c16f50]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:55 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 Jul 16 13:07:55 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:55 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:55 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 6e9eb506-8c15-49de-8d72-f2542b1ac76d of volume 846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[613334f5-6553-4dbe-b82a-8e7679b68b1d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 Jul 16 13:07:56 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2 Jul 16 13:07:56 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440 Jul 16 13:07:56 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd.78a36924-2714-4bd4-897b-ba4951bb2ad2" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-78a36924-2714-4bd4-897b-ba4951bb2ad2" released by "_delete_snapshot" :: held 1.608s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-2c4fb11b-f097-4617-a461-87f25823e440" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d 1G Jul 16 13:07:56 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" released by "delete_snapshot" :: held 1.645s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-2c4fb11b-f097-4617-a461-87f25823e440" released by "delete_volume" :: held 0.794s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Created reservations ['23441d47-55bf-46d5-874f-aab3b4d113ca', '0936ee57-a716-4b5c-bd38-2e0cbaed5b16', 'aafd36ae-a2c4-4d2c-bbb9-f2ae39da0c69', '16ea53a8-edf2-4c29-a7ea-119e36ddf7d7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Created reservations ['1f78cdd0-562b-47b6-a43c-78eea1e60c84', '93f01bc0-0283-4cf7-82e8-5684e0f46b03', '12468ba0-fe1d-4a55-9333-b92b1cd09ea1', '65aff706-8569-4da9-a3b3-dd752cc2df76'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:56 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Delete snapshot completed successfully. Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47e35747-be7a-48cf-b4c5-eb71aa040234 tempest-ProjectReaderTests-986599878 None] Lock "cinder-78a36924-2714-4bd4-897b-ba4951bb2ad2-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-d9c0009f-cb6b-4577-b5d3-79ebb6e64398-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-d9c0009f-cb6b-4577-b5d3-79ebb6e64398-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[049814b6-5280-468f-89f1-0da76b7d21e2]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Deleted volume successfully. Jul 16 13:07:56 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d 1G" returned: 0 in 0.564s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846ac540-4026-46e9-bacc-f81fa1728d80 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3d03f085-e9b9-4943-9467-e42c1f021ef6 tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-2c4fb11b-f097-4617-a461-87f25823e440-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-07af156d-c028-41ac-b5ca-c3b676dc38fd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:56 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846ac540-4026-46e9-bacc-f81fa1728d80 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d Jul 16 13:07:56 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "cinder-07af156d-c028-41ac-b5ca-c3b676dc38fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:57 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 Jul 16 13:07:57 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Acquiring lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b41b00-db63-4c6b-aae2-fd185caf41fc]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd Jul 16 13:07:57 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846ac540-4026-46e9-bacc-f81fa1728d80 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d is being set with open permissions: ugo+rw Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d Jul 16 13:07:57 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398 Jul 16 13:07:57 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd Jul 16 13:07:57 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-quobyte-d9c0009f-cb6b-4577-b5d3-79ebb6e64398" released by "delete_volume" :: held 0.725s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info Jul 16 13:07:57 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Created reservations ['edecf97b-e97a-4d3e-b9e6-5569b2b89c5c', '363c6a59-584f-4ee9-9851-5b0eace73f99', '3735ad72-4598-47d1-a452-ceb8080c22eb', '9a0c356c-a329-478a-92bb-c1315b211c61'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-07af156d-c028-41ac-b5ca-c3b676dc38fd" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:57 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "cinder-quobyte-07af156d-c028-41ac-b5ca-c3b676dc38fd" released by "delete_volume" :: held 0.711s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Created reservations ['8989243a-035b-4db8-bda3-e47b3386d015', '24334622-f923-4d97-aef6-87619dd002a3', '61960c2d-e61e-44ea-80e2-32df6a5d3e50', '7add30af-f203-485b-93f3-55c32044ac6b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:07:57 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:57 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info is being set with open permissions: ugo+rw Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:57 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info Jul 16 13:07:57 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:57 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:07:57 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:58 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Deleted volume successfully. Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9a196456-af10-4379-b905-a9e005e9571d tempest-SnapshotDependencyTests-67715678 None] Lock "cinder-d9c0009f-cb6b-4577-b5d3-79ebb6e64398-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:58 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.info" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:07:58 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:07:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-75614f27-c66d-4961-b70b-0f78abeae58a tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:07:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Deleted volume successfully. Jul 16 13:07:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3dbd67b7-8146-436a-a21e-6cc0c6b96e1e tempest-ProjectReaderTests-986599878 None] Lock "cinder-07af156d-c028-41ac-b5ca-c3b676dc38fd-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-6e9eb506-8c15-49de-8d72-f2542b1ac76d-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-6e9eb506-8c15-49de-8d72-f2542b1ac76d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-6e9eb506-8c15-49de-8d72-f2542b1ac76d" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-6e9eb506-8c15-49de-8d72-f2542b1ac76d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 6e9eb506-8c15-49de-8d72-f2542b1ac76d of volume 846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ac6117-7c9b-464d-9c61-411ddf189486]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:59 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d Jul 16 13:07:59 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:07:59 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d" returned: 0 in 0.425s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-846ac540-4026-46e9-bacc-f81fa1728d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c241b00-d7b2-4d0c-a8c5-e0d3cb757697]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:07:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:07:59 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 Jul 16 13:07:59 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:00 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:00 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d Jul 16 13:08:00 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:00 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:00 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d Jul 16 13:08:00 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:00 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80.6e9eb506-8c15-49de-8d72-f2542b1ac76d" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-6e9eb506-8c15-49de-8d72-f2542b1ac76d" released by "_delete_snapshot" :: held 1.758s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" released by "delete_snapshot" :: held 1.796s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Created reservations ['a9254dd1-39c5-4c49-9d11-fac9b5da70b0', '9530bfaf-e247-4b09-8b0d-928a163938e5', '9728a39b-ddca-4767-bc3b-ed945c6f482e', '09c82d5a-a0c1-47f6-a27e-e4a9cc9abda9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4ce7a34d-17c9-4804-88c8-1c9357a19992 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-6e9eb506-8c15-49de-8d72-f2542b1ac76d-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-846ac540-4026-46e9-bacc-f81fa1728d80-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-846ac540-4026-46e9-bacc-f81fa1728d80-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[36426576-4a4b-4118-8b94-bac901b65997]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:01 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 Jul 16 13:08:01 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:01 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80" returned: 0 in 0.478s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:02 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80 Jul 16 13:08:02 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:02 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-846ac540-4026-46e9-bacc-f81fa1728d80" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-846ac540-4026-46e9-bacc-f81fa1728d80" released by "delete_volume" :: held 0.840s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Created reservations ['1974bad2-6643-4552-8454-85aed89d30ad', 'd864a745-fe85-4d78-83a7-e722024b829d', 'ea70d01d-32f5-4413-a5af-6ca4b7c28e18', 'ee09bcc4-7fea-4f49-b7e6-5145c58ea87f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:02 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:02 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:02 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3a3e22c9-1eb4-4554-9ddf-8ec49c3e3a31 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-846ac540-4026-46e9-bacc-f81fa1728d80-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=184,cinder:INSERT=66,cinder:UPDATE=218,cinder:DELETE=21 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=167,cinder:UPDATE=220,cinder:DELETE=16,cinder:INSERT=53 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (40fe8de8-87c5-44d9-8097-cdb0a85d8cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b940c-5f4b-486e-ac08-7efc9b716176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b940c-5f4b-486e-ac08-7efc9b716176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305132399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a8c8f-450d-41e8-86ca-7ec81fb31276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:03Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cf372-acb2-47bb-b42e-6591dd2f7273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cf372-acb2-47bb-b42e-6591dd2f7273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db596e9-cfee-4bae-9715-79cbfc10c1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db596e9-cfee-4bae-9715-79cbfc10c1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64a8c8f-450d-41e8-86ca-7ec81fb31276', 'volume_name': 'volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aad484-cf5f-4472-bb55-be86528dbbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68aad484-cf5f-4472-bb55-be86528dbbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2294df56-a2d0-4884-9167-fe35b1e92c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Volume d64a8c8f-450d-41e8-86ca-7ec81fb31276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276', 'volume_size': 1} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305132399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64a8c8f-450d-41e8-86ca-7ec81fb31276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:03Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Creating volume d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:03 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 1073741824 Jul 16 13:08:03 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:03 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 1073741824" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:03 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 Jul 16 13:08:03 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:04 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2294df56-a2d0-4884-9167-fe35b1e92c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fc9457-cb11-4501-91c1-d00c2aa38306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Volume volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 (d64a8c8f-450d-41e8-86ca-7ec81fb31276): created successfully Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fc9457-cb11-4501-91c1-d00c2aa38306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (40fe8de8-87c5-44d9-8097-cdb0a85d8cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-71380b07-6e57-4bd8-be1d-ac7db7f0988e tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 5074f63c-264e-4e44-83a1-884409c92681 of volume d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d045526-f7b8-4e6b-8f99-d626fed11e4f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:05 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 Jul 16 13:08:05 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:05 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:06 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 1G Jul 16 13:08:06 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:06 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 1G" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:06 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 Jul 16 13:08:06 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:06 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:06 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 is being set with open permissions: ugo+rw Jul 16 13:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:06 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 Jul 16 13:08:06 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:07 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:07 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info Jul 16 13:08:07 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:07 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info is being set with open permissions: ugo+rw Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:07 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info Jul 16 13:08:07 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:07 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.info" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-66058b69-26d0-45e4-b3af-f58a007c34af tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-5074f63c-264e-4e44-83a1-884409c92681-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5074f63c-264e-4e44-83a1-884409c92681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-5074f63c-264e-4e44-83a1-884409c92681" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5074f63c-264e-4e44-83a1-884409c92681" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 5074f63c-264e-4e44-83a1-884409c92681 of volume d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c326a109-6f3c-437a-a5d9-5165e52d6cc3]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:08 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 Jul 16 13:08:08 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:08 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:08 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:09 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c1554e-b568-4635-8d32-b8af42c17665]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:09 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 29 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 16 13:08:09 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 Jul 16 13:08:09 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:09 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276" returned: 0 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:09 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 Jul 16 13:08:09 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:09 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:09 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681 Jul 16 13:08:09 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:09 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276.5074f63c-264e-4e44-83a1-884409c92681" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5074f63c-264e-4e44-83a1-884409c92681" released by "_delete_snapshot" :: held 1.362s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" released by "delete_snapshot" :: held 1.384s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Created reservations ['cd8bf95e-1ae6-424f-97af-4c0cdf9bbd1e', '4ef8ad46-e2ce-4e0f-bc5d-bc2d92e02f3c', '1e62dbf0-d431-4ca2-b069-baf48d5fdb65', '921466ac-46f7-4914-a9e3-78704a7075b6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9db75a33-6d1d-469f-bb70-b7b273ef72ce tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5074f63c-264e-4e44-83a1-884409c92681-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-d64a8c8f-450d-41e8-86ca-7ec81fb31276-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-d64a8c8f-450d-41e8-86ca-7ec81fb31276-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[179b5f78-cc22-4e1d-8896-d32e10cbc5f0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:10 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 Jul 16 13:08:10 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:11 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:11 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276 Jul 16 13:08:11 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:11 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-d64a8c8f-450d-41e8-86ca-7ec81fb31276" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d64a8c8f-450d-41e8-86ca-7ec81fb31276" released by "delete_volume" :: held 0.645s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Created reservations ['28115fec-6ee7-4fae-8df6-5fe77a7fcf19', 'f4da3ff0-2e50-4a34-9ed0-aa29a8dfa74b', '3f3d067b-856b-4045-ac54-3bd75083b879', '2e194405-748d-4f12-96f2-48192b602e42'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:11 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:11 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:11 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0fa281d9-eacd-4ca5-908f-bc0eaa43217d tempest-ProjectMemberTests-1354279683 None] Lock "cinder-d64a8c8f-450d-41e8-86ca-7ec81fb31276-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (64e11018-eeeb-4589-bf0d-76d60dac7af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d955b6-220d-4195-9220-edee56a387bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d955b6-220d-4195-9220-edee56a387bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523118969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7af1a-4866-4e42-83b0-f45136f3c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:12Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c32c07-1d6b-4fbd-adbf-22942c292745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c32c07-1d6b-4fbd-adbf-22942c292745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32925cb7-60f4-4d89-9f2a-7eb64cd571bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32925cb7-60f4-4d89-9f2a-7eb64cd571bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a7af1a-4866-4e42-83b0-f45136f3c82d', 'volume_name': 'volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34023ac5-68b5-4d18-813e-d37ca1489853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34023ac5-68b5-4d18-813e-d37ca1489853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896fb919-0bb5-41c7-9faf-6c1c0a057e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Volume a6a7af1a-4866-4e42-83b0-f45136f3c82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d', 'volume_size': 1} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1523118969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7af1a-4866-4e42-83b0-f45136f3c82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:12Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Creating volume a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:12 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d 1073741824 Jul 16 13:08:12 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:12 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d 1073741824" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:12 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d Jul 16 13:08:12 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:13 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896fb919-0bb5-41c7-9faf-6c1c0a057e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf02d20b-4e02-4600-8118-56f7ebebfb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Volume volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d (a6a7af1a-4866-4e42-83b0-f45136f3c82d): created successfully Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf02d20b-4e02-4600-8118-56f7ebebfb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (64e11018-eeeb-4589-bf0d-76d60dac7af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9de1cb6-f462-4f30-b240-6a765194c3e2 tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 5757221f-5b28-49ca-8217-3dfe42baf509 of volume a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca4330-2334-4e0d-8daf-84ff660b6a78]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:13 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d Jul 16 13:08:13 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:13 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:13 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 1G Jul 16 13:08:13 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:14 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 1G" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:14 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 Jul 16 13:08:14 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:14 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:14 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 is being set with open permissions: ugo+rw Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:14 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 Jul 16 13:08:14 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:14 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:14 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info Jul 16 13:08:14 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:15 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:15 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info is being set with open permissions: ugo+rw Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:15 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info Jul 16 13:08:15 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:15 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.info" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-728fff80-3362-414f-9185-34acaa47fe36 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-5757221f-5b28-49ca-8217-3dfe42baf509-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5757221f-5b28-49ca-8217-3dfe42baf509-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-5757221f-5b28-49ca-8217-3dfe42baf509" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5757221f-5b28-49ca-8217-3dfe42baf509" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 5757221f-5b28-49ca-8217-3dfe42baf509 of volume a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d57ffb-7708-45c7-8e39-6f420e9bcd91]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:15 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 Jul 16 13:08:15 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:16 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb8732-711a-4def-afd7-ad4affe79bb0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:16 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d Jul 16 13:08:16 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:16 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:16 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 Jul 16 13:08:16 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:16 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:16 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509 Jul 16 13:08:16 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:16 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d.5757221f-5b28-49ca-8217-3dfe42baf509" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5757221f-5b28-49ca-8217-3dfe42baf509" released by "_delete_snapshot" :: held 1.366s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" released by "delete_snapshot" :: held 1.389s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Created reservations ['c6173b46-3f40-4822-a81b-11bf23d074a6', 'e0852c8e-a585-47f0-ac8d-ee13c2fad248', 'bdebf6a1-d00c-4f38-9278-3033098eae90', '700f0bea-5b52-4a15-9ee8-69e0530d8ce5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-70ed5408-7981-4274-b224-7aeb1443c330 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5757221f-5b28-49ca-8217-3dfe42baf509-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-a6a7af1a-4866-4e42-83b0-f45136f3c82d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-a6a7af1a-4866-4e42-83b0-f45136f3c82d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[721eca4e-3331-4151-a681-598b5bd49e73]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:17 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d Jul 16 13:08:17 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:18 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:18 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d Jul 16 13:08:18 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:18 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-a6a7af1a-4866-4e42-83b0-f45136f3c82d" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-a6a7af1a-4866-4e42-83b0-f45136f3c82d" released by "delete_volume" :: held 0.644s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Created reservations ['24bb52ff-3443-4b2f-a6bb-ed72ee9df652', '75f3e5ec-46d3-4fa6-b0c6-fc278eb8befd', 'd73ad748-7129-4af7-854b-41b57d728400', '08a9aef1-15c4-4e6d-8951-96cb6617e4f4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:18 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:18 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:18 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8cc8981b-8c4b-4d61-a84e-9ba7f2cece63 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-a6a7af1a-4866-4e42-83b0-f45136f3c82d-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (0c963876-4102-4b3d-bbc9-b6795b2cd54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2409f7f-62e1-4fd4-b0f0-322bb95b3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2409f7f-62e1-4fd4-b0f0-322bb95b3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093349660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faf91f2-c584-4a3a-a177-ee713316183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:19Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbe77df-7a63-438f-9d7e-603d81b33e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbe77df-7a63-438f-9d7e-603d81b33e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5bba7c-94d9-4cfb-8fa1-99e66dbc7242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5bba7c-94d9-4cfb-8fa1-99e66dbc7242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1faf91f2-c584-4a3a-a177-ee713316183e', 'volume_name': 'volume-1faf91f2-c584-4a3a-a177-ee713316183e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658090c-5e2c-4227-967a-f22e43bed69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9658090c-5e2c-4227-967a-f22e43bed69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d827ab22-d936-4dd2-b873-db0b71c8600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Volume 1faf91f2-c584-4a3a-a177-ee713316183e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1faf91f2-c584-4a3a-a177-ee713316183e', 'volume_size': 1} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093349660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1faf91f2-c584-4a3a-a177-ee713316183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:19Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Creating volume 1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:19 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:19 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e 1073741824 Jul 16 13:08:19 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:19 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e 1073741824" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:19 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e Jul 16 13:08:19 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:20 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d827ab22-d936-4dd2-b873-db0b71c8600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1faf91f2-c584-4a3a-a177-ee713316183e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4075f9-a741-4736-a416-845ea2be16e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Volume volume-1faf91f2-c584-4a3a-a177-ee713316183e (1faf91f2-c584-4a3a-a177-ee713316183e): created successfully Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4075f9-a741-4736-a416-845ea2be16e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (0c963876-4102-4b3d-bbc9-b6795b2cd54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c51c8d91-fa80-4e46-a6b0-4ef48a7373ab tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 5decc593-8813-4624-bd05-bfff52c122a7 of volume 1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc858eae-21db-4da7-820f-45c04edbabf1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:20 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e Jul 16 13:08:20 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:20 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:20 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 1G Jul 16 13:08:20 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:21 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 1G" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1faf91f2-c584-4a3a-a177-ee713316183e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:21 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1faf91f2-c584-4a3a-a177-ee713316183e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 Jul 16 13:08:21 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:21 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1faf91f2-c584-4a3a-a177-ee713316183e -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:21 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 is being set with open permissions: ugo+rw Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:21 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 Jul 16 13:08:21 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:21 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:21 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info Jul 16 13:08:21 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:22 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:22 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info is being set with open permissions: ugo+rw Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:22 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info Jul 16 13:08:22 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:22 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.info" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-14dd9c0e-1143-4508-92f6-9492ec4bebf1 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-5decc593-8813-4624-bd05-bfff52c122a7-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5decc593-8813-4624-bd05-bfff52c122a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-5decc593-8813-4624-bd05-bfff52c122a7" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5decc593-8813-4624-bd05-bfff52c122a7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 5decc593-8813-4624-bd05-bfff52c122a7 of volume 1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b1d804-ef69-4e4c-9de0-0be32d53483f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:22 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 Jul 16 13:08:22 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:23 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1faf91f2-c584-4a3a-a177-ee713316183e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cb1f93-4e8d-453f-8f15-d31c1eebdc79]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:23 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e Jul 16 13:08:23 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:23 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:23 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 Jul 16 13:08:23 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:23 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:23 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7 Jul 16 13:08:23 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:23 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e.5decc593-8813-4624-bd05-bfff52c122a7" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-5decc593-8813-4624-bd05-bfff52c122a7" released by "_delete_snapshot" :: held 1.370s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" released by "delete_snapshot" :: held 1.390s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Created reservations ['a64c2391-b370-4b7d-aaf3-d06e46c31bd6', 'e7bfd70a-ee73-4405-b471-c9f5a2a3f0e7', 'a82376f2-914d-4cd8-a37b-238d9ae1e0a4', '0bedf6b1-6da7-449c-a1ed-1c617e64fb35'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0d76203f-3a93-4293-b27e-686aedb4ad91 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-5decc593-8813-4624-bd05-bfff52c122a7-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-1faf91f2-c584-4a3a-a177-ee713316183e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "cinder-1faf91f2-c584-4a3a-a177-ee713316183e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7554049-85c6-4ac3-a895-f3ce73e7f0ae]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:24 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e Jul 16 13:08:24 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:25 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:25 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e Jul 16 13:08:25 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:25 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1faf91f2-c584-4a3a-a177-ee713316183e" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1faf91f2-c584-4a3a-a177-ee713316183e" released by "delete_volume" :: held 0.683s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Created reservations ['0f521ec0-5436-4d15-8ef9-29995015bb53', '6ba92bff-1de8-4ca4-aeb8-08798b14cd25', 'a6c35054-3aae-485e-bd47-c6b96935b15c', '639f905f-9a92-4ef5-8c4f-206ddf0cd97e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:25 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:25 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:25 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95bbd6cd-5006-4988-beef-2273662bfc7b tempest-ProjectMemberTests-1354279683 None] Lock "cinder-1faf91f2-c584-4a3a-a177-ee713316183e-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (4cf5493d-383c-47e2-89ae-9e74165b5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56646318-b03f-4749-8939-7bb43cfb8a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56646318-b03f-4749-8939-7bb43cfb8a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89172277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:26Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a5da1e-cd27-43de-aaf6-9444f5812a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a5da1e-cd27-43de-aaf6-9444f5812a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f27ef9-146c-45fe-9ee5-cee05ee1b193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f27ef9-146c-45fe-9ee5-cee05ee1b193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c', 'volume_name': 'volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e23992-80fa-4ed0-b060-5a55aa6b156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e23992-80fa-4ed0-b060-5a55aa6b156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6812879-c974-4c9f-998a-61db254f13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Volume 1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c', 'volume_size': 1} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89172277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:26Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Creating volume 1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:26 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c 1073741824 Jul 16 13:08:26 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:26 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c 1073741824" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:26 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c Jul 16 13:08:26 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:27 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6812879-c974-4c9f-998a-61db254f13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15e2fce-ae03-46f5-97ee-df80876179e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Volume volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c (1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c): created successfully Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15e2fce-ae03-46f5-97ee-df80876179e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (4cf5493d-383c-47e2-89ae-9e74165b5062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aad13e97-39e5-4700-8727-55bee7651bcf tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot d96271e6-9c82-4a38-bbab-edc0c59ef128 of volume 1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc05a0ed-0d3b-401a-b425-d18c03e47682]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:27 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c Jul 16 13:08:27 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:27 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:27 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 1G Jul 16 13:08:27 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:28 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 1G" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:28 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 Jul 16 13:08:28 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:28 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:28 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 is being set with open permissions: ugo+rw Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:28 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 Jul 16 13:08:28 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:28 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:28 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info Jul 16 13:08:28 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:29 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:29 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info is being set with open permissions: ugo+rw Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:29 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info Jul 16 13:08:29 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:29 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2dd3be5b-ca18-48f3-b604-ed8a577ed315 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-d96271e6-9c82-4a38-bbab-edc0c59ef128-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-d96271e6-9c82-4a38-bbab-edc0c59ef128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-d96271e6-9c82-4a38-bbab-edc0c59ef128" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d96271e6-9c82-4a38-bbab-edc0c59ef128" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot d96271e6-9c82-4a38-bbab-edc0c59ef128 of volume 1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da16a15-0920-4b32-948f-31d495e0b704]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:29 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 Jul 16 13:08:29 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:30 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c23f79-abb7-4fea-a603-39a1c28275ce]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:30 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c Jul 16 13:08:30 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:30 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:30 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 Jul 16 13:08:30 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:30 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:30 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128 Jul 16 13:08:30 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:31 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c.d96271e6-9c82-4a38-bbab-edc0c59ef128" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-d96271e6-9c82-4a38-bbab-edc0c59ef128" released by "_delete_snapshot" :: held 1.374s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" released by "delete_snapshot" :: held 1.393s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Created reservations ['eacc7ca2-50dc-4424-991e-fdd6853c9d13', '50bfbbd1-c788-4045-a009-364e5fbcb0f9', '75d2a2a3-477d-4b13-840e-76eaea92e826', '16bd4b54-070d-48b8-8573-67ad0980d5c7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-28484942-3640-4844-ae2b-c9e3805ab109 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-d96271e6-9c82-4a38-bbab-edc0c59ef128-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "cinder-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[83227fb0-e4f3-4193-8bdd-5006cbd7f0c5]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:32 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c Jul 16 13:08:32 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:32 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:32 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c Jul 16 13:08:32 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:32 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c" released by "delete_volume" :: held 0.645s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Created reservations ['b5b88ea4-d8c4-4184-86c1-b1c37c585c7a', '33a95272-c70b-4870-a933-57a091e6ced2', '818a9afe-f11a-412b-ac0f-cdd51f43a56d', '6b696c0f-60c5-4faa-832b-6340cce5f515'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:32 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:32 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:32 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-546f6ee4-1b74-4cfb-992d-f50def60ebaf tempest-ProjectMemberTests-1354279683 None] Lock "cinder-1aa8c0a6-1c37-486a-8eb4-bc6bed9d758c-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (2dca3b36-d405-45fc-806a-ecd4d60149a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7c8efa-4f09-40ec-96d4-721a2f3d14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7c8efa-4f09-40ec-96d4-721a2f3d14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437232736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6d8e8-c917-42fb-aa8a-5ee76ee6914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:33Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f54b48-1809-48e2-bb52-3925a94b578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f54b48-1809-48e2-bb52-3925a94b578b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64d6db-db34-4640-ad40-4bbe75a0cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c64d6db-db34-4640-ad40-4bbe75a0cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf6d8e8-c917-42fb-aa8a-5ee76ee6914c', 'volume_name': 'volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c5ab07-c077-4d36-971b-999ad39a3582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c5ab07-c077-4d36-971b-999ad39a3582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81355d1a-6088-46e1-a1b4-a0923c7153c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Volume adf6d8e8-c917-42fb-aa8a-5ee76ee6914c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c', 'volume_size': 1} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-437232736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf6d8e8-c917-42fb-aa8a-5ee76ee6914c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b22bf23d32d472fa30ea62e19257426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:33Z,use_quota=True,user_id='8105c5666d1845159b9d4b90e1c14a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Creating volume adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:33 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c 1073741824 Jul 16 13:08:33 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:33 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c 1073741824" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:33 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c Jul 16 13:08:33 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:34 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81355d1a-6088-46e1-a1b4-a0923c7153c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432bf397-c731-4dfd-a6b0-cf0a02f1b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Volume volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c (adf6d8e8-c917-42fb-aa8a-5ee76ee6914c): created successfully Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432bf397-c731-4dfd-a6b0-cf0a02f1b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Flow 'volume_create_manager' (2dca3b36-d405-45fc-806a-ecd4d60149a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-61c9cdb8-797c-4378-a5e1-2e7b0f06c70f tempest-ProjectMemberTests-1354279683 None] Created volume successfully. Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Creating offline snapshot 2c4bf66b-6763-4e9b-9f9a-d88ddd395828 of volume adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dc4a0b-f5f3-4d4c-8f4f-ccfb6df522a1]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:34 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c Jul 16 13:08:34 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:34 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:34 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 1G Jul 16 13:08:34 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:35 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 1G" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:35 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 Jul 16 13:08:35 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:35 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c -F qcow2 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:35 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 is being set with open permissions: ugo+rw Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:35 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 Jul 16 13:08:35 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:35 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:35 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info Jul 16 13:08:35 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:36 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:36 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info is being set with open permissions: ugo+rw Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:36 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info Jul 16 13:08:36 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:36 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.info" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-50a68ec5-521a-45cd-8528-7927fbcb0a92 tempest-ProjectMemberTests-1354279683 None] Create snapshot completed successfully Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-2c4bf66b-6763-4e9b-9f9a-d88ddd395828-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-2c4bf66b-6763-4e9b-9f9a-d88ddd395828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-2c4bf66b-6763-4e9b-9f9a-d88ddd395828" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-2c4bf66b-6763-4e9b-9f9a-d88ddd395828" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Deleting offline snapshot 2c4bf66b-6763-4e9b-9f9a-d88ddd395828 of volume adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] snapshot_file for this snap is: volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a694d16-43c3-421f-9887-9ae70cddb99f]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:36 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 Jul 16 13:08:36 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:37 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b715a5e-37a2-4997-a091-c2d04a1f1e0e]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:37 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c Jul 16 13:08:37 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:37 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:37 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 Jul 16 13:08:37 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:37 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:37 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828 Jul 16 13:08:37 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:38 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c.2c4bf66b-6763-4e9b-9f9a-d88ddd395828" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-2c4bf66b-6763-4e9b-9f9a-d88ddd395828" released by "_delete_snapshot" :: held 1.379s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" released by "delete_snapshot" :: held 1.400s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Created reservations ['3eeae160-b577-4b10-9d01-f5aa04ebed99', '650064b4-a395-44f3-bebf-944620be5dd0', '4b422d6c-f38d-4a64-a2dc-d0a394f10732', '05aefb5a-05cb-4124-a1b5-94ed4455bca5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Delete snapshot completed successfully. Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7fc9fe9-8606-42a7-8558-7f9822864b21 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-2c4bf66b-6763-4e9b-9f9a-d88ddd395828-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b3336-7537-48d4-9572-1e850c3c2ca0]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:39 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c Jul 16 13:08:39 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:39 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:39 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c Jul 16 13:08:39 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:39 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-quobyte-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c" released by "delete_volume" :: held 0.657s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Created reservations ['864a265f-d19f-487f-9ee8-605769a27587', 'd0207b8c-5c24-47f9-acc2-a1aad50de6de', '139c0811-8e80-4535-9612-43404ec0b8ab', 'b5034c28-d679-4ab7-86dc-f9058a1fd2a6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:39 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:39 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:39 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:39 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Deleted volume successfully. Jul 16 13:08:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-602abd37-1453-4cdb-9cc8-61423d35d044 tempest-ProjectMemberTests-1354279683 None] Lock "cinder-adf6d8e8-c917-42fb-aa8a-5ee76ee6914c-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (e5d04bfd-cbc9-4ea7-bf10-60d72534cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae71c94-3fe7-4434-a56e-cf7b915e6abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae71c94-3fe7-4434-a56e-cf7b915e6abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280071668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:44Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbf335d-b31d-43ba-a8ea-e7135d55be38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbf335d-b31d-43ba-a8ea-e7135d55be38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1528d2-a9c8-4a69-ae91-bde7c5e0c0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1528d2-a9c8-4a69-ae91-bde7c5e0c0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9', 'volume_name': 'volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10ec70e-ab49-452c-8dd0-3976d9e51d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10ec70e-ab49-452c-8dd0-3976d9e51d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611dd74f-3668-4086-9854-187fc7ec859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Volume 795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9', 'volume_size': 1} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280071668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:44Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Creating volume 795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:43 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 1073741824 Jul 16 13:08:43 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:44 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 1073741824" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:44 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 Jul 16 13:08:44 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:44 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611dd74f-3668-4086-9854-187fc7ec859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80800d-2354-4b0b-a143-b8ae65b19a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Volume volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 (795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9): created successfully Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff80800d-2354-4b0b-a143-b8ae65b19a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (e5d04bfd-cbc9-4ea7-bf10-60d72534cd42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ecc740b-7e97-46a1-bcfa-69054180b377 tempest-ProjectReaderTests-1820617388 None] Created volume successfully. Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-quobyte-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fcdfca-fdb5-4203-bea9-8f170eff80c6]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:45 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 Jul 16 13:08:45 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:45 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:45 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9 Jul 16 13:08:45 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:45 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9" released by "delete_volume" :: held 0.644s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Created reservations ['61db6e45-d3fd-4ec4-bc2f-84a8c13fe595', '13b7529a-e3a4-4048-9d09-6254674acc90', 'fa37c299-ef3a-4e39-8489-c14c3e47fabd', 'eafc8ee9-0349-4394-8e5f-a3dfe38488fd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:45 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:45 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:45 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Deleted volume successfully. Jul 16 13:08:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c6be7b52-c378-4dd5-86d8-1ca05ecbda1d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-795cd5da-ed9b-4dd3-9f12-aef7d0ec63b9-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (e091e159-4070-4cfe-b83b-66eaf7cc8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d36b8-a09e-4f7f-b123-a5e0f3480600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4d36b8-a09e-4f7f-b123-a5e0f3480600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273421385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c710f547-1e64-4a32-a287-04874da10953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:46Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac04ee34-bdac-4288-8fe9-ffeeded26421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac04ee34-bdac-4288-8fe9-ffeeded26421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e358ad41-9d93-4142-84b4-24c64f192eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e358ad41-9d93-4142-84b4-24c64f192eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c710f547-1e64-4a32-a287-04874da10953', 'volume_name': 'volume-c710f547-1e64-4a32-a287-04874da10953', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd88537-03ba-479e-94c7-f3dcbb9f41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd88537-03ba-479e-94c7-f3dcbb9f41ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f4da6-1120-4fac-ad8c-9102b2727b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Volume c710f547-1e64-4a32-a287-04874da10953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c710f547-1e64-4a32-a287-04874da10953', 'volume_size': 1} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1273421385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c710f547-1e64-4a32-a287-04874da10953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:46Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Creating volume c710f547-1e64-4a32-a287-04874da10953 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:46 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:46 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 1073741824 Jul 16 13:08:46 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:46 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 1073741824" returned: 0 in 0.422s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:46 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 Jul 16 13:08:46 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:47 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f4da6-1120-4fac-ad8c-9102b2727b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c710f547-1e64-4a32-a287-04874da10953', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3f818e-3ca5-49b4-9dca-a79797c4b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Volume volume-c710f547-1e64-4a32-a287-04874da10953 (c710f547-1e64-4a32-a287-04874da10953): created successfully Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3f818e-3ca5-49b4-9dca-a79797c4b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (e091e159-4070-4cfe-b83b-66eaf7cc8a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c1988345-ff7d-4aee-9cc1-bcedda20a8cc tempest-ProjectReaderTests-1820617388 None] Created volume successfully. Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-c710f547-1e64-4a32-a287-04874da10953-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-c710f547-1e64-4a32-a287-04874da10953-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-quobyte-c710f547-1e64-4a32-a287-04874da10953" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-c710f547-1e64-4a32-a287-04874da10953" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4770e27-2a87-4216-8868-e7c95c42b4f8]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:47 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 Jul 16 13:08:47 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:47 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:47 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953 Jul 16 13:08:47 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:48 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-c710f547-1e64-4a32-a287-04874da10953" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-c710f547-1e64-4a32-a287-04874da10953" released by "delete_volume" :: held 0.643s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Created reservations ['09c2c643-357b-4d51-971e-cd752cb41d42', '39f727b6-150a-4024-bfaf-a808206cf44f', '9dae925e-1dd4-4b82-a531-7fc5725c04ec', '0de56fa3-f664-4e44-b856-326dfe5878f4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:48 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:48 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:48 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Deleted volume successfully. Jul 16 13:08:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c523c90c-ca02-4e2f-9d6c-ac5a9fb220f2 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-c710f547-1e64-4a32-a287-04874da10953-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (19104c22-859e-4aaa-ac63-ca0f3ed48382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdb32b5-8999-437b-a7dd-75b5a8b91f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bdb32b5-8999-437b-a7dd-75b5a8b91f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705270324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff09c482-500e-485f-a628-2985c440089e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:49Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f512e976-9b64-452f-8e18-a9d5aecf8fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f512e976-9b64-452f-8e18-a9d5aecf8fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690d67b3-f392-4116-bf2f-b4e29e5fd13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (690d67b3-f392-4116-bf2f-b4e29e5fd13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff09c482-500e-485f-a628-2985c440089e', 'volume_name': 'volume-ff09c482-500e-485f-a628-2985c440089e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bea542-d810-4e61-a60a-2232ef61187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bea542-d810-4e61-a60a-2232ef61187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3a96e4-135d-4ade-be61-d0eab2c29556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Volume ff09c482-500e-485f-a628-2985c440089e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff09c482-500e-485f-a628-2985c440089e', 'volume_size': 1} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-705270324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff09c482-500e-485f-a628-2985c440089e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:49Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Creating volume ff09c482-500e-485f-a628-2985c440089e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:49 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e 1073741824 Jul 16 13:08:49 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:49 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e 1073741824" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:49 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e Jul 16 13:08:49 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:49 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3a96e4-135d-4ade-be61-d0eab2c29556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff09c482-500e-485f-a628-2985c440089e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a0df4-954c-4224-b807-cf76832042bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Volume volume-ff09c482-500e-485f-a628-2985c440089e (ff09c482-500e-485f-a628-2985c440089e): created successfully Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a0df4-954c-4224-b807-cf76832042bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (19104c22-859e-4aaa-ac63-ca0f3ed48382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-389af332-591d-4b7c-aa15-f707e060d67e tempest-ProjectReaderTests-1820617388 None] Created volume successfully. Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-ff09c482-500e-485f-a628-2985c440089e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-ff09c482-500e-485f-a628-2985c440089e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-quobyte-ff09c482-500e-485f-a628-2985c440089e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-ff09c482-500e-485f-a628-2985c440089e" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec92457-e54a-46e8-8801-efd07477d890]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:50 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e Jul 16 13:08:50 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:50 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:50 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e Jul 16 13:08:50 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:50 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-ff09c482-500e-485f-a628-2985c440089e" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-ff09c482-500e-485f-a628-2985c440089e" released by "delete_volume" :: held 0.632s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Created reservations ['c799cbe7-f983-4499-b5a0-3ed620eff187', 'f83f0c0e-6837-45c3-ae35-6a908c149ead', 'ee776c12-2df2-488c-ba17-fd4a33e1d094', '76d3555e-5a80-40f7-9e5e-ba5dccaa21c7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:50 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:50 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:51 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Deleted volume successfully. Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-864d50fa-0f90-48d2-b58a-1938a659c02d tempest-ProjectReaderTests-1820617388 None] Lock "cinder-ff09c482-500e-485f-a628-2985c440089e-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (8a60b4c4-2ee6-4d17-aa15-6dbc6cfec9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6c1488-5530-4cbc-b752-a27199e073f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6c1488-5530-4cbc-b752-a27199e073f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135671206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcc327e-10f5-47c9-9896-3ab209de261f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:52Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbb5d86-0688-4b57-b4cd-b946c4397402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbb5d86-0688-4b57-b4cd-b946c4397402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f6cc17-1a98-45a4-b349-1024a7cf82f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f6cc17-1a98-45a4-b349-1024a7cf82f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcc327e-10f5-47c9-9896-3ab209de261f', 'volume_name': 'volume-7bcc327e-10f5-47c9-9896-3ab209de261f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79717b2b-a9dd-4653-9d9d-e982ecd265bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79717b2b-a9dd-4653-9d9d-e982ecd265bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2ef9c5-333f-46c8-aa32-aa3002fb53d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Volume 7bcc327e-10f5-47c9-9896-3ab209de261f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcc327e-10f5-47c9-9896-3ab209de261f', 'volume_size': 1} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-16T11:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135671206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bcc327e-10f5-47c9-9896-3ab209de261f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56d3bee51ba4722be235a5ac4f59b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-16T11:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-16T11:08:52Z,use_quota=True,user_id='034150b4aa5f49b9a8e25afa5bbd02be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f77db31-71b5-4cf2-8019-de54d38da464),volume_type_id=0f77db31-71b5-4cf2-8019-de54d38da464)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Creating volume 7bcc327e-10f5-47c9-9896-3ab209de261f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Selected osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 16 13:08:51 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] casted to osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1 Jul 16 13:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:51 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f 1073741824 Jul 16 13:08:51 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:52 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f 1073741824" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:52 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f Jul 16 13:08:52 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:52 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2ef9c5-333f-46c8-aa32-aa3002fb53d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcc327e-10f5-47c9-9896-3ab209de261f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8081c50-cf9b-4d4b-8091-8091339d6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 16 13:08:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Volume volume-7bcc327e-10f5-47c9-9896-3ab209de261f (7bcc327e-10f5-47c9-9896-3ab209de261f): created successfully Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8081c50-cf9b-4d4b-8091-8091339d6bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Flow 'volume_create_manager' (8a60b4c4-2ee6-4d17-aa15-6dbc6cfec9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 16 13:08:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9f6976bc-b1bb-402a-9f91-84c9a425c343 tempest-ProjectReaderTests-1820617388 None] Created volume successfully. Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-7bcc327e-10f5-47c9-9896-3ab209de261f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-7bcc327e-10f5-47c9-9896-3ab209de261f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "cinder-quobyte-7bcc327e-10f5-47c9-9896-3ab209de261f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-7bcc327e-10f5-47c9-9896-3ab209de261f" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e7fbff-6e16-4295-b089-9a6c1470f07d]: (4, 'qcow2') {{(pid=89076) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 16 13:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:52 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f Jul 16 13:08:52 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:53 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:53 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f Jul 16 13:08:53 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:53 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a/volume-7bcc327e-10f5-47c9-9896-3ab209de261f" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-quobyte-7bcc327e-10f5-47c9-9896-3ab209de261f" released by "delete_volume" :: held 0.640s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Created reservations ['609e8e44-056a-4262-af83-44c39a7957a7', '6490668f-8e55-4ffc-849c-da70c2678352', 'eaebca9c-fca6-4a1b-adb0-7be72fdf6aa3', '7a79f545-bd1d-4078-8d4e-160a1e084130'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:08:53 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:08:53 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:08:53 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:08:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Deleted volume successfully. Jul 16 13:08:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6eaa5a18-dbea-4743-8b0a-109d304f3d16 tempest-ProjectReaderTests-1820617388 None] Lock "cinder-7bcc327e-10f5-47c9-9896-3ab209de261f-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 16 13:09:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:INSERT=36,cinder:UPDATE=131,cinder:DELETE=13,cinder:SELECT=91 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:09:03 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=105,cinder:UPDATE=137,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-632f739c-c287-48f3-adee-4ff425fe9cc1'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 16 13:09:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 16 13:09:08 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a Jul 16 13:09:08 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 16 13:09:09 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 16 13:09:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68c2f5d72ac3f65e1505db2d32b7925a" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 16 13:09:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 16 13:09:09 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 16 13:09:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread count: 29 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 16 13:09:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7aea9a67-ef92-41a4-a99b-02aa8aa7ff33 None None] thread info: [<_MainThread(MainThread, started 124325366591616)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}